We propose a novel uplink communication method, coined random orthogonalization, for federated learning (FL) in a massive multiple-input and multiple-output (MIMO) wireless system. The key novelty of random orthogonalization comes from the tight coupling of FL model aggregation and two unique characteristics of massive MIMO - channel hardening and favorable propagation. As a result, random orthogonalization can achieve natural over-the-air model aggregation without requiring transmitter side channel state information, while significantly reducing the channel estimation overhead at the receiver. Theoretical analyses with respect to both communication and machine learning performances are carried out. In particular, an explicit relationship among the convergence rate, the number of clients and the number of antennas is established. Experimental results validate the effectiveness and efficiency of random orthogonalization for FL in massive MIMO.
翻译:我们建议一种新型的上行链路通信方法,即随机或分解式通信方法,用于在一个大型的多输入和多输出无线系统中进行联合学习(FL),随机正方形新颖的关键在于FL模型聚合的紧密结合以及大型MIMO的两种独特的特性——频道硬化和有利的传播。结果,随机正方形组合可以实现自然的超空模型聚合,而不需要发射器侧端频道国家信息,同时大大降低接收器的频道估计间接费用。对通信和机器学习性能进行了理论分析。特别是,在通信和机器学习性能的趋同率、客户数量和天线数量之间建立了明确的关系。实验结果验证了大型MIMO中FL随机或分解的效能和效率。