This paper describes the tool CASPA, a new performance evaluation tool which is based on a Markovian stochastic process algebra. CASPA uses multi-terminal binary decision diagrams (MTBDD) to represent the labelled continuous time Markov chain (CTMC) underlying a given process algebraic specification. All phases of modelling, from model construction to numerical analysis and measure computation,...

the stochastic reaction diffusion systems may suffer sudden shocks‎, ‎in order to explain this phenomena‎, ‎we use markovian jumps to model stochastic reaction diffusion systems‎. ‎in this paper‎, ‎we are interested in almost sure exponential stability of stochastic reaction diffusion systems with markovian jumps‎. ‎under some reasonable conditions‎, ‎we show that the trivial solution of stocha...

The notion of equivalence that is typically used to relate Markovian process terms and to reduce their underlying state spaces is Markovian bisimilarity. The reason is that, besides being a congruence, Markovian bisimilarity is consistent with ordinary lumping, an exact aggregation for Markov chains. In this paper we show that two non-bisimulation-based Markovian behavioral equivalences – Marko...

we compare two approaches for a markovian model in flexible manufacturing systems (fmss) using monte carlo simulation. the model which is a development of fazlollahtabar and saidi-mehrabad (2013), considers two features of automated flexible manufacturing systems equipped with automated guided vehicle (agv) namely, the reliability of machines and the reliability of agvs in a multiple agv jobsho...

Reinforcement Learning (RL) in either fully or partially observable domains usually poses a requirement on the knowledge representation in order to be sound: the underlying stochastic process must be Markovian. In many applications, including those involving interactions between multiple agents (e.g., humans and robots), sources of uncertainty affect rewards and transition dynamics in such a wa...

We study the issues arising when considering the problem of recon guring broadcast optical networks in response to changes in the tra c patterns. Although the ability to dynamically optimize the network under changing tra c conditions has been recognized as one of the key features of multiwavelength optical networks, this is the rst indepth study of the tradeo s involved in carrying out the rec...

We study the issues arising when considering the problem of reconnguring broadcast optical networks in response to changes in the traac patterns. Although the ability to dynamically optimize the network under changing traac conditions has been recognized as one of the key features of mul-tiwavelength optical networks, this is the rst in-depth study of the tradeoos involved in carrying out the r...