‎in this work we introduce and study discrete time periodically correlated stable‎ ‎processes and multivariate stationary stable processes related to periodic and cyclic‎ ‎flows‎. ‎our study involves producing a spectral representation and a‎ ‎spectral identification for such processes‎. ‎we show that the third‎ ‎component of a periodically correlated stable process has a component related to a...

Markov chains1 and Markov decision processes (MDPs) are special cases of stochastic games. Markov chains describe the dynamics of the states of a stochastic game where each player has a single action in each state. Similarly, the dynamics of the states of a stochastic game form a Markov chain whenever the players’ strategies are stationary. Markov decision processes are stochastic games with a ...

In their standard formulations, stochastic games and Markov decision processes assume a rational opponent or a stationary environment. Online learning algorithms can adapt to arbitrary opponents and non-stationary environments, but do not incorporate the dynamic structure of stochastic games or Markov decision processes. We survey recent approaches that apply online learning to dynamic environm...