This chapter is concerned with the application of approximate dynamic programming techniques (ADP) to solve for the value function, and hence the optimal control policy, in discrete-time nonlinear optimal control problems having continuous state and action spaces. ADP is a reinforcement learning approach (Sutton & Barto, 1998) based on adaptive critics (Barto et al., 1983), (Widrow et al., 1973...

A new formulation of a trajectory tracking controller for flexible joint robotic manipulator is proposed. The controller is based on the continuous time nonlinear predictive control approach wherein predicted errors in the actual response and the desired response and current control expenditure is minimized point-wise to obtain an optimal, nonlinear feedback control law. It is shown that the we...

This paper attempts to achieve time-optimal performance for servomechanisms via a practical feedback control law. An improvement over the traditional Proximate Time Optimal Servomechanism (PTOS) is proposed in order to eliminate the conservatism present in the controller. The original PTOS switches from the nonlinear approximation of Time Optimal Control (TOC) to a linear controller as the syst...

The swing-up control of a triple pendulum on a cart is presented, where the controller is based on a two-degrees-of-freedom scheme consisting of a nonlinear feedforward controller and an optimal feedback controller. The point-to-point transition task is treated as a nonlinear two-point boundary value problem with free parameters resulting from the suitably projected inputoutput dynamics. The ma...

In this paper, twin rotor multi input multi output system (TRMS) is considered as a prototype laboratory set-up of helicopter. The aim of studying the model of TRMS and designing the controller for it is to provide a platform for controlling the flight of helicopter. An optimal state feedback controller based on linear quadratic regulator (LQR) technique has been designed for twin rotor multi i...

this paper presents a new optimization algorithm to design an optimal proportional, integral, derivative (pid) controller in hydro-turbine generator governor for damping output frequency oscillations. in this research, we utilize a stochastic and optimal based pid controller to control frequency-response of the hydro turbine. the proposed algorithm is employed to design an optimal pid controlle...

Equation Chapter 1 Section 1 Abstract— The concept of PID controllers (proportional integral derivative) belongs to the most frequently used principles of controlling in industrial and non-industrial applications. The process of setting of PID controller can be determined as optimization task. Requiring optimal settings of PID controller we can specify more goals of optimization which are ofte...