We address the problem of finding a natural continuous time Markov type process—in open populations—that best captures information provided by an chain in discrete which is usually sole possible observation from data. Given chain, we single out two main approaches: In first one, consider calibration procedure process using transition matrix and show that, when embeddable has optimal solutions. ...

A Markov chain in discrete time, {Xn : n ≥ 0}, remains in any state for exactly one unit of time before making a transition (change of state). We proceed now to relax this restriction by allowing a chain to spend a continuous amount of time in any state, but in such a way as to retain the Markov property. As motivation, suppose we consider the rat in the open maze. Clearly it is more realistic ...

A Markov chain in discrete time, {Xn : n ≥ 0}, remains in any state for exactly one unit of time before making a transition (change of state). We proceed now to relax this restriction by allowing a chain to spend a continuous amount of time in any state, but in such a way as to retain the Markov property. As motivation, suppose we consider the rat in the open maze. Clearly it is more realistic ...

A Markov chain in discrete time, {Xn : n ≥ 0}, remains in any state for exactly one unit of time before making a transition (change of state). We proceed now to relax this restriction by allowing a chain to spend a continuous amount of time in any state, but in such a way as to retain the Markov property. As motivation, suppose we consider the rat in the open maze. Clearly it is more realistic ...

It is well known that random walks and similar Markov chains [l] can be used as approximations for or analogs to Brownian motion or diffusion which are more precisely described by continuous stochastic processes. In cormection with digital system analysis it is also desirable to have Markov chains, which approximate continuous processes with finite variance [2], [3]. Moreover, it is an importan...

aspirin is one of the certified medicines commonly used for the secondary prevention of myocardial infarction (mi). aspirin side effects and gastrointestinal bleeding, in particular, have arisen debates on its use for the primary prevention of mi. the present research evaluates the cost-effectiveness of the use of aspirin in the primary prevention of mi among iranian men with average cardiovasc...

b a c k g r o u n d & aim: the aim of the current study was to investigate the advantages of bayesian method in comparison to traditional methods to detect best antioxidant in freezing of human male gametes. methods  &  materials:   semen  samples  were  obtained  from  40  men  whose  sperm  had  normal criteria. a part of each sample was separated without antioxidant  as fresh and the remaini...

we propose to use a mathematical method based on stochastic comparisons of markov chains in order to derive performance indice bounds‎. ‎the main goal of this paper is to investigate various monotonicity properties of a single server retrial queue with first-come-first-served (fcfs) orbit and general retrial times using the stochastic ordering techniques‎.

A solution method for solving Markov chains for a class of stochastic process algebra terms is presented. The solution technique is based on a reformulation of the underlying continuous-time Markov chain (CTMC) in terms of semi-Markov processes. For the reformulation only local information about the processes running in parallel is needed, and it is therefore never necessary to generate the com...