Markov chain convergence: From finite to infinite
نویسندگان
چکیده
منابع مشابه
Markov chain convergence : from finite to infinite by Jeffrey
Bounds on convergence rates for Markov chains are a very widely-studied topic, motivated largely by applications to Markov chain Monte Carlo algorithms. For Markov chains on finite state spaces, previous authors have obtained a number of very useful bounds, including those which involve choices of paths. Unfortunately, many Markov chains which arise in practice are not finite. In this paper, we...
متن کاملFinite Markov Chain Analysis
Finite, discrete-time Markov chain models of genetic algorithms have been used successfully in the past to understand the complex dynamics of a simple GA. Markov chains can exactly model the GA by accounting for all of the stochasticity introduced by various GA operators, such as initialization, selection, crossover, and mutation. Although such models quickly become unwieldy with increasing pop...
متن کاملInfinite Combinatorics: from Finite to Infinite
We investigate the relationship between some theorems in finite combinatorics and their infinite counterparts: given a “finite” result how one can get an “infinite” version of it? We will also analyze the relationship between the proofs of a “finite” theorem and the proof of its “infinite” version. Besides these comparisons, the paper gives a proof of a theorem of Erdős, Grünwald and Vázsonyi g...
متن کاملMarkov Chain Decomposition for Convergence Rate Analysis
In this paper we develop tools for analyzing the rate at which a reversible Markov chain converges to stationarity. Our techniques are useful when the Markov chain can be decomposed into pieces which are themselves easier to analyze. The main theorems relate the spectral gap of the original Markov chains to the spectral gap of the pieces. In the first case the pieces are restrictions of the Mar...
متن کاملConvergence of Pseudo-Finite Markov Chains
Note: After completing this paper, it was discovered that similar ideas had been studied previously by others (see A.
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Stochastic Processes and their Applications
سال: 1996
ISSN: 0304-4149
DOI: 10.1016/0304-4149(95)00082-8