In this note, we first recall the nonconvex problem setting and introduce the optimal PAGE algorithm (Li et al., ICML'21). Then we provide a simple and clean convergence analysis of PAGE for achieving optimal convergence rates. Moreover, PAGE and its analysis can be easily adopted and generalized to other works. We hope that this note provides the insights and is helpful for future works.
翻译:在本说明中,我们首先回顾非混凝土问题设置,并采用最佳PAG算法(Li等人,ICML'21),然后对PAGE进行简单、干净的趋同分析,以实现最佳趋同率,此外,PAGE及其分析很容易被采纳,并推广到其他工作,我们希望本说明提供见解,有助于未来的工作。