This review paper provides an introduction of Markov chains and their convergence rates which is an important and interesting mathematical topic which also has important applications for very widely used Markov chain Monte Carlo (MCMC) algorithm. We first discuss eigenvalue analysis for Markov chains on finite state spaces. Then, using the coupling construction, we prove two quantitative bounds based on minorization condition and drift conditions, and provide descriptive and intuitive examples to showcase how these theorems can be implemented in practice. This paper is meant to provide a general overview of the subject and spark interest in new Markov chain research areas.
翻译:本审查文件介绍了Markov链条及其趋同率,这是一个重要而有趣的数学专题,它对于广泛使用的Markov链条Monte Carlo(MCMC)算法也有重要的应用。我们首先讨论对限定国家空间的Markov链条的精精华价值分析。然后,我们利用混合结构,根据微小化条件和漂移条件,证明两个量化界限,并提供描述性和直观的例子,以展示这些理论如何在实践中得到实施。本文旨在提供该主题的总体概况,并激发人们对新的Markov链条研究领域的兴趣。