In this note, the sequence of the interarrivals of a stationary Markovian Arrival process is shown to be ρ-mixing with a geometric rate of convergence when the driving process is ρ-mixing. This provides an answer to an issue raised in the recent paper [4] on the geometric convergence of the autocorrelation function of the stationary Markovian Arrival process. keywords: Markov renewal process AM...

We already proposed a decision making system for autonomous robots, which is based on a Markovian emotional model proposed by Banik. In our proposed system, decision making of the robot is designed automatically by two processes that are the construction of emotions and optimization of behavior selection policy for emotions. In this study, we introduce an experiences-based reconstruction of emo...

— We define a notion of Markov process indexed by curves drawn on a compact surface and taking its values in a compact Lie group. We call such a process a two-dimensional Markovian holonomy field. The prototype of this class of processes, and the only one to have been constructed before the present work, is the canonical process under the Yang-Mills measure, first defined by Ambar Sengupta [32]...

The advantages of using stochastic process algebra to specify performance models are well-documented. There remains, however, a reluctance in some quarters to use process algebras; this is particularly the case amongst queueing theorists. This paper demonstrates the use of a Markovian process algebra to represent a wide range of queueing models. Moreover, it shows that the most common interacti...

It is shown that all statistical properties of the generalized Langevin equation with Gaussian fluctuations are determined by a single, two-point correlation function. The resulting description corresponds with a stationary, Gaussian, non-Markovian process. Fokker-Planck-like equations are discussed, and it is explained how they can lead one to the erroneous conclusion that the process is nonst...

This manuscript uses machine learning techniques to exploit baseball pitchers’ decision making, so-called “Baseball IQ,” by modeling the at-bat information, pitch selection and counts, as a Markov Decision Process (MDP). Each state of the MDP models the pitcher’s current pitch selection in a Markovian fashion, conditional on the information immediately prior to making the current pitch. This in...

Formal languages with semantics based on ordinary differential equations (ODEs) have emerged as a useful tool to reason about large-scale distributed systems. We present differential bisimulation, a behavioral equivalence developed as the ODE counterpart of bisimulations for languages with probabilistic or stochastic semantics. We study it in the context of a Markovian process algebra. Similarl...