Abstract We propose dual form of Markov renewal equations. While the dual form is theoretically equivalent to the classical standard form of Markov renewal equation, it is shown to be a useful tool for analysis of recent stochastic models. To demonstrate the power of the dual form of Markov renewal equations, we apply one to tail asymptotic analysis of the stationary workload distribution for a...

Solution concepts help designing co-evolutionary algorithms by interfacing search mechanisms and problems. This work analyses co-evolutionary dynamics by coupling the notion of solution concept with a Markov chain model of coevolution. It is shown that once stationarity has been reached by the Markov chain, and given a particular solution concept of interest, the dynamics can be seen as a Berno...

Hidden Markov models (HMMs) are a class of stochastic models that have proven to be powerful tools for the analysis of molecular sequence data. A hidden Markov model can be viewed as a black box that generates sequences of observations. The unobservable internal state of the box is stochastic and is determined by a finite state Markov chain. The observable output is stochastic with distribution...

Due to the effective role of Markov models in customer relationship management (CRM), there is a lack of comprehensive literature review which contains all related literatures. In this paper the focus is on academic databases to find all the articles that had been published in 2011 and earlier. One hundred articles were identified and reviewed to find direct relevance for applying Markov models...

We consider an extension of Discrete Time Markov Chain queueing model to the quantum domain by use of Discrete Time Quantum Markov Chain. We introduce methods for numerical analysis of such models. Using this tools we show that quantum model behaves fundamentally differently from the classical one.

Key properties of multimedia traac are characterized by the great diversity of correlation and burstiness. Construct the multimedia traac by heterogeneous 2-state Markov chains as in 1] 2]. Here we allow each 2-state MC to be deened on diierent transition intervals, representing the diversity of peak access rate from individual sources. Upon time renormalization, the queue is modeled by a multi...

This study uses latent transition analysis to examine reading development across the kindergarten and 1st-grade year. Data include poverty status and dichotomous measures of reading at 4 time points for a large sample of children within the Early Childhood Longitudinal Study. In each of 4 waves of the study, 5 latent classes were represented in different proportions: low alphabet knowledge, ear...