To efficiently exploit the massive amounts of raw data that are increasingly being generated in mobile edge networks, federated learning (FL) has emerged as a promising distributed learning technique. By collaboratively training a shared learning model on edge devices, raw data transmission and storage are replaced by the exchange of the local computed parameters/gradients in FL, which thus helps address latency and privacy issues. However, the number of resource blocks when using traditional orthogonal transmission strategies for FL linearly scales with the number of participating devices, which conflicts with the scarcity of communication resources. To tackle this issue, over-the-air computation (AirComp) has emerged recently which leverages the inherent superposition property of wireless channels to perform one-shot model aggregation. However, the aggregation accuracy in AirComp suffers from the unfavorable wireless propagation environment. In this paper, we consider the use of intelligent reflecting surfaces (IRSs) to mitigate this problem and improve FL performance with AirComp. Specifically, a performance-oriented design scheme that directly minimizes the optimality gap of the loss function is proposed to accelerate the convergence of AirComp-based FL. We first analyze the convergence behavior of the FL procedure with the absence of channel fading and noise. Based on the obtained optimality gap which characterizes the impact of channel fading and noise in different communication rounds on the ultimate performance of FL, we propose both online and offline approaches to tackle the resulting design problem. Simulation results demonstrate that such a performance-oriented design strategy can achieve higher test accuracy than the conventional isolated mean square error (MSE) minimization approach in FL.
翻译:为了有效利用移动边缘网络正在产生的大量原始数据,联合学习(FL)已成为一种有希望的分布式学习技术。通过合作培训边端设备共同学习模式,原始数据传输和储存被FL当地计算参数/梯度的交换所取代,从而有助于解决隐蔽和隐私问题。然而,在使用传统正方位传输战略的FL线性规模使用传统正方位传输战略时,资源区块的数目与参与装置的数目相冲突,这种战略与通信资源稀缺相冲突。为了解决这一问题,最近出现了空中计算(AirComp),利用无线频道固有的精度超升功能来进行一发式模型聚合。然而,AirComp的集成精度精度取决于不易变异的无线传播环境。在本文中,我们考虑使用智能反射表面(IRS)来缓解这一问题,并改进Aircomproducal的功能。具体地说,一种面向性能设计机制,直接将损失功能的最佳性差距降到最低程度。为了加速基于AirComp-FL的系统测试结果,我们首先分析在FL系统设计过程中的精确度设计过程的趋趋趋趋一致,然后在FL系统上显示FL的最佳性能,从而在FL系统设计上显示FL的最佳性能。