Sensitivity and uncertainty analysis of Markov-reward models
نویسندگان
چکیده
منابع مشابه
Sensitivity and uncertainty analysis of Markov-reward models - Reliability, IEEE Transactions on
Conclusions Markov-reward models are often used to analyze the reliability & performability of computer systems. One difficult problem therein is the quantification of the model parameters. If they are available, eg, from measurement data collected by manufacturers, they are, a) generally regarded as confidential, and b) difficult to access. This paper addresses two ways of dealing with uncerta...
متن کاملNumerical Analysis of Large Markov Reward Models
First analysis of Markov Reward Models (MRM) resulted in a double transform expression, whose numerical solution is based on the inverse transformations both in time and reward variable domain. Better numerical methods were proposed based on the time domain properties of these models, such as the set of partial differential equation describes the process evolution in time. This paper introduces...
متن کاملAnalysis of Inhomogeneous Markov Reward Models
The majority of computational methods applied for the analysis of homogeneous Markov reward models (MRMs) are not applicable for the analysis of inhomogeneous MRMs. By the nature of inhomogeneous models only forward differential equations can be used to describe the model behaviour. In this paper we provide forward partial differential equations describing the distribution of reward measures of...
متن کاملMoments analysis in Markov reward models
We analyze the moments of the accumulated reward over the interval (0, t) in a continuous-time Markov chain. We develop a numerical procedure to efficiently compute the normalized moments using the uniformization technique. Our algorithm involves auxiliary quantities whose convergence is analyzed, and for which we provide a probabilistic interpretation. Key-words: Markov models, accumulated rew...
متن کاملSensitivity Analysis in Markov Decision Processes with Uncertain Reward Parameters
Sequential decision problems can often be modeled as Markov decision processes. Classical solution approaches assume that the parameters of the model are known. However, model parameters are usually estimated and uncertain in practice. As a result, managers are often interested in how estimation errors affect the optimal solution. In this paper we illustrate how sensitivity analysis can be perf...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Reliability
سال: 1995
ISSN: 0018-9529
DOI: 10.1109/24.376541