In this paper, we provide exponential rates of convergence to the interior Nash equilibrium for continuous-time dual-space game dynamics such as mirror descent (MD) and actor-critic (AC). We perform our analysis in $N$-player continuous concave games that satisfy certain monotonicity assumptions while possibly also admitting potential functions. In the first part of this paper, we provide a novel relative characterization of monotone games and show that MD and its discounted version converge with $\mathcal{O}(e^{-\beta t})$ in relatively strongly and relatively hypo-monotone games, respectively. In the second part of this paper, we specialize our results to games that admit a relatively strongly concave potential and show AC converges with $\mathcal{O}(e^{-\beta t})$. These rates extend their known convergence conditions. Simulations are performed which empirically back up our results.
翻译:在本文的第一部分,我们提供了与内部纳什平衡的指数率,用于连续时间的双空间游戏动态,如镜像下沉(MD)和演员-critic(AC)等。我们用美元玩家连续共鸣游戏进行分析,这些游戏满足某些单调假设,同时可能也承认潜在功能。在本文的第一部分,我们提供了单调游戏的新颖相对特征,并显示MD及其折扣版与$\mathcal{O}(e ⁇ -\beta t})相融合,在相对强和相对低调的双空游戏中。在本文第二部分,我们将我们的结果专门用于接受相对强调潜力的游戏,并展示AC与$\mathcal{O}(e ⁇ -beta t})的趋同。这些比率延长了已知的趋同条件。在经验上支持了我们结果的模拟。