We prove the existence of limiting distributions for a large class of Markov chains on a general state space in a random environment. We assume suitable versions of the standard drift and minorization conditions. In particular, the system dynamics should be contractive on the average with respect to the Lyapunov function and large enough small sets should exist with large enough minorization constants. We also establish that a law of large numbers holds for bounded functionals of the process. Applications to queuing systems, to machine learning algorithms and to autoregressive processes are presented.
翻译:我们证明,在随机的环境中,在一般状态空间存在着对一大批马可夫链条的限制分布,我们假定标准漂移和微小化条件的适当版本,特别是,系统动态应平均压缩Lyapunov功能,足够大的小型机组应存在足够大的细化常数。我们还确定,大量法则对过程的捆绑功能持有一定的约束力。还介绍了排队系统、机器学习算法和自动递减程序的应用。