First-order methods are often analyzed via their continuous-time models, where their worst-case convergence properties are usually approached via Lyapunov functions. In this work, we provide a systematic and principled approach to find and verify Lyapunov functions for classes of ordinary and stochastic differential equations. More precisely, we extend the performance estimation framework, originally proposed by Drori and Teboulle [10], to continuous-time models. We retrieve convergence results comparable to those of discrete methods using fewer assumptions and convexity inequalities, and provide new results for stochastic accelerated gradient flows.
翻译:第一级方法往往通过连续时间模型进行分析,在这些模型中,最坏情况的趋同特性通常通过Lyapunov函数进行,在这项工作中,我们提供系统、有原则的方法,寻找和核实普通和随机差异方程式类别的Lyapunov函数。更准确地说,我们把最初由Drori和Teboule提出的业绩估计框架[10] 扩大到连续时间模型。我们利用较少的假设和细化的不平等,检索与离散方法相类似的趋同结果,并为随机加速梯度流动提供新的结果。