In this letter, we study the problem of accelerating reaching average consensus over connected graphs in a discrete-time communication setting. Literature has shown that consensus algorithms can be accelerated by increasing the graph connectivity or optimizing the weights agents place on the information received from their neighbors. In this letter instead of altering the communication graph, we investigate two methods that use buffered states to accelerate reaching average consensus over a given graph. In the first method, we study how convergence rate of the well-known first-order Laplacian average consensus algorithm changes with delayed feedback and obtain a sufficient condition on the ranges of delay that leads to faster convergence. In the second proposed method, we show how average consensus problem can be cast as a convex optimization problem and solved by first-order accelerated optimization algorithms for strongly-convex cost functions. We construct the fastest converging average consensus algorithm using the so-called Triple Momentum optimization algorithm. We demonstrate our results using an in-network linear regression problem, which is formulated as two average consensus problems.
翻译:在这封信中,我们研究了在离散时间通信环境中加速就相连接的图形达成平均共识的问题。文学显示,通过增加图形连接或优化从邻居处获得的信息的重量代理器,可以加速达成共识的算法。在这封信中,我们不是修改通信图,而是调查使用缓冲状态加速就某一图表达成平均共识的两种方法。在第一个方法中,我们研究众所周知的一阶拉普拉卡西亚平均共识算法变化的趋同率,加上延迟反馈,并获得导致更快趋同的延迟幅度的充分条件。在第二个拟议方法中,我们展示了如何将平均共识问题描绘成一个螺旋形优化问题,并通过一阶加速优化算法解决,以达到强趋同成本功能。我们用所谓的Triple Momentum优化算法构建了最快的一致平均一致算法。我们用一个网络内线性回归问题展示了我们的结果,这是两个平均共识问题。