Following the recently developed algorithms for fully probabilistic control design for general dynamic stochastic systems (Herzallah & Káarnáy, 2011; Kárný, 1996), this paper presents the solution to the probabilistic dual heuristic programming (DHP) adaptive critic method (Herzallah & Káarnáy, 2011) and randomized control algorithm for stochastic nonlinear dynamical systems. The purpose of the...

In this article we propose a new technique for efficiently solving a specialized instance of a finite state sequential decision process. This specialized task requires keeping a system within a set of nominal states, introducing control actions only when forbidden states are entered. Instead of assuming that the process evolves only due to control actions, we assume that system evolution occurs...

In this paper, we study a class of optimal stochastic control problems involving two different time scales. The fast mode of the system is represented by deterministic state equations whereas the slow mode of the system corresponds to a jump disturbance process. Under a fundamental “ergodicity” property for a class of “infinitesimal control systems” associated with the fast mode, we show that t...

a memory control for t-s fuzzy discrete-time systems with sto- chastic input delay is proposed in this paper. dierent from the common assumptions on the time delay in the existing literatures, it is assumed in this paper that the delays vary randomly and satisfy some probabilistic dis- tribution. a new state space model of the discrete-time t-s fuzzy system is derived by introducing some stocha...

Since Pardoux and Peng firstly studied the following nonlinear backward stochastic differential equations in 1990. The theory of BSDE has been widely studied and applied, especially in the stochastic control, stochastic differential games, financial mathematics and partial differential equations. In 1994, Pardoux and Peng came up with backward doubly stochastic differential equations to give th...

In this paper, an optimal singular stochastic control problem is considered. For this model, it is obtained a general stochastic maximum principle by using a time transformation. This is the first version of the stochastic maximum principle that covers the singular control problem in the nonlinear case.

Along with the progress of science and technology development social civilization, control system brings an increasingly significant function in daily life. The application field is very wide, for instance, mobile [1], artificial earth satellite [2], pest [3], etc.