In this paper, we study Markov fluid queues where the net fluid rate to a single-buffer system varies with respect to the state of an underlying continuous-time Markov chain. We present a novel algorithmic approach to solve numerically for the steady-state solution of such queues. Using this approach, both infiniteand finite-buffer cases are studied. We show that the solution of the infinite-bu...

In this paper we study the asymptotic behavior of stochastic approximation schemes with set-valued drift function and non-additive iterate-dependent Markov noise. We show that a linearly interpolated trajectory of such a recursion is an asymptotic pseudotrajectory for the flow of a limiting differential inclusion obtained by averaging the set-valued drift function of the recursion w.r.t. the st...

A risk process with constant premium rate c and Poisson arrivals of claims is considered. A threshold r is defined for claim interarrival times, such that if k consecutive interarrival times are larger than r, then the next claim has distribution G. Otherwise, the claim size distribution is F . Asymptotic expressions for the infinite horizon ruin probabilities are given for both lightand the he...

We consider a signal process X taking values in a complete, separable metric space E. X is assumed to be a Markov process charachterized via the martingale problem for an operator A. In the context of the finitely additive white noise theory of filtering, we show that the optimal filter Γt(y) is the unique solution of the analogue of the Zakai equation for every y, not necessarily continuous. T...

We consider a signal process X taking values in a complete, separable metric space E. X is assumed to be a Markov process charachterized via the martingale problem for an operator A. In the context of the finitely additive white noise theory of filtering, we show that the optimal filter Γt(y) is the unique solution of the analogue of the Zakai equation for every y, not necessarily continuous. T...

Risk processes are considered, which locally behave as a Brownian motion with some drift and variance, both depending on an underlying Markov chain that is used also to generate the claims arrival process. Thus claims arrive according to a renewal process with waiting times of phase-type. The claims are assumed to form an iid sequence, independent of everything else, and with a distribution wit...

in this paper, absorbing markov chain models are developed to determine the optimum process mean levels for both a single-stage and a serial two-stage production system in which items are inspected for conformity with their specification limits. when the value of the quality characteristic of an item falls below a lower limit, the item is scrapped. if it falls above an upper limit, the item is ...

A method of estimating a variety of curves by a sequence of piecewise polynomials is proposed, motivated by a Bayesian model and an appropriate summary of the resulting posterior distribution. A joint distribution is set up over both the number and the position of the knots de®ning the piecewise polynomials. Throughout we use reversible jump Markov chain Monte Carlo methods to compute the poste...