In conventional federated learning (FL), differential privacy (DP) guarantees can be obtained by injecting additional noise to local model updates before transmitting to the parameter server (PS). In the wireless FL scenario, we show that the privacy of the system can be boosted by exploiting over-the-air computation (OAC) and anonymizing the transmitting devices. In OAC, devices transmit their model updates simultaneously and in an uncoded fashion, resulting in a much more efficient use of the available spectrum. We further exploit OAC to provide anonymity for the transmitting devices. The proposed approach improves the performance of private wireless FL by reducing the amount of noise that must be injected.
翻译:在传统联合学习(FL)中,在传送到参数服务器(PS)之前,通过对当地模型更新进行更多的噪音,可以获得差异隐私保障。在无线FL假设情景中,我们表明,通过利用空中计算(OAC)和将传输装置匿名,可以提高系统的隐私。在OAC, 设备同时以未编码的方式传输其模型更新,从而更有效地利用现有频谱。我们进一步利用OAC为传输装置提供匿名。拟议办法通过减少必须注入的噪音量,改善了私人无线FL的性能。