The actor-critic (AC) reinforcement learning algorithms have been the powerhouse behind many challenging applications. Nevertheless, its convergence is fragile in general. To study instability, existing works mostly consider uncommon double-loop variant or basic models with finite state and action space. We investigate more practical single-sample two-timescale AC for solving canonical linear q...

As the conventional control system is a controller that controls or regulates dynamics of any other process. From time to time, this may not behave appropriately online; because many factors like some variation in process itself unexpected changes environment, even undefined parameters model. To overcome problem above, an adaptive designed and implemented. This paper discusses design for ball b...

This article develops a novel method based on the memetic algorithm for optimal feedback control design. The aircraft controllers are designed to produce desired handling qualities. The robust properties of the linear quadratic regulator are exploited to obtain the desired aircraft handling qualities with an output feedback constrained linear quadratic regulator subspace based on a cost functio...

A semi-active control strategy for suspension systems of passenger cars is presented employing Magnetorheological (MR) dampers. The vehicle is modeled with seven DOFs including the, roll pitch and bounce of car body, and the vertical motion of the four tires. In order to design an optimal controller based on the actuator constraints, a Linear-Quadratic Regulator (LQR) is designed. The design pr...

Designing controller for the Multi Input Multi Output (MIMO) process is difficult because of the changes in process dynamics and interactions between process variables. This paper presents the approach to design a Linear Quadratic Gaussian (LQG) Controller for a multivariable process with a transmission zero using Linear Quadratic Regulator (LQR) and Kalman’s state estimation techniques. The pe...

in this paper, the dynamic simulation for a high pressure regulator is performed to obtain the regulator behavior. to analyze the regulator performance, the equation of motion for inner parts, the continuity equation for diverse chambers and the equation for mass flow rate were derived. because of nonlinearity and coupling, these equations are solved using numerical methods and the results are ...

This paper presents the optimal regulator for a linear system with state delay and a quadratic criterion. The optimal regulator equations are obtained using the maximum principle. Performance of the obtained optimal regulator is verified in the illustrative example against the best linear regulator available for linear systems without delays. Simulation graphs demonstrating better performance o...

Reinforcement learning (RL) has been successfully used to solve many continuous control tasks. Despite its impressive results however, fundamental questions regarding the sample complexity of RL on continuous problems remain open. We study the performance of RL in this setting by considering the behavior of the Least-Squares Temporal Difference (LSTD) estimator on the classic Linear Quadratic R...

This paper addresses the optimal control problem known as the Linear Quadratic Regulator in the case when the dynamics are unknown. We propose a multi-stage procedure, called Coarse-ID control, that estimates a model from a few experimental trials, estimates the error in that model with respect to the truth, and then designs a controller using both the model and uncertainty estimate. Our techni...

The linear quadratic regulator for vibration systems subject to seismic excitations is discussed in his own physical newtonian space as a second-order differential system with matrix coefficients. leads fourth-order and transversality conditions. Those are studied basis generated by fundamental solution.