This paper examines the problem of designing a robust H∞ state-feedback controller for a class of nonlinear two-time scale systems with Markovian Jumps described by a Takagi-Sugeno (TS) fuzzy model. Based on a linear matrix inequality (LMI) approach, LMI-based sufficient conditions for the uncertain Markovian jump nonlinear two-time scale systems to have an H∞ performance are derived. The propo...

Actor–critic style two-time-scale algorithms are one of the most popular methods in reinforcement learning, and have seen great empirical success. However, their performance is not completely understood theoretically. In this article, we characterize global convergence an online natural actor–c...

[Context and motivation] Self-adaptation empowers systems with the capability to meet stakeholders’ requirements in a dynamic environment. Such systems autonomously monitor changes and events which drive adaptation decisions at runtime. Social Adaptation is a recent kind of requirements-driven adaptation which enables users to give a runtime feedback on the success and quality of a system’s con...

The problem of dynamic feedback equivalence of nonlinear control systems on time scales is studied. Time scale is a model of time. Two most important cases are the real line (continuous time) and the set of integers (discrete time). Control systems on time scales include continuous-time and discrete-time systems. The delta algebra of a nonlinear control system is introduced. The main result say...