Machine learning (ML) is a widely accepted means for supporting customized services for mobile devices and applications. Federated Learning (FL), which is a promising approach to implement machine learning while addressing data privacy concerns, typically involves a large number of wireless mobile devices to collect model training data. Under such circumstances, FL is expected to meet stringent training latency requirements in the face of limited resources such as demand for wireless bandwidth, power consumption, and computation constraints of participating devices. Due to practical considerations, FL selects a portion of devices to participate in the model training process at each iteration. Therefore, the tasks of efficient resource management and device selection will have a significant impact on the practical uses of FL. In this paper, we propose a spectrum allocation optimization mechanism for enhancing FL over a wireless mobile network. Specifically, the proposed spectrum allocation optimization mechanism minimizes the time delay of FL while considering the energy consumption of individual participating devices; thus ensuring that all the participating devices have sufficient resources to train their local models. In this connection, to ensure fast convergence of FL, a robust device selection is also proposed to help FL reach convergence swiftly, especially when the local datasets of the devices are not independent and identically distributed (non-iid). Experimental results show that (1) the proposed spectrum allocation optimization method optimizes time delay while satisfying the individual energy constraints; (2) the proposed device selection method enables FL to achieve the fastest convergence on non-iid datasets.
翻译:联邦学习组织(FL)是支持移动设备和应用程序定制服务的一种广泛接受的手段,它是一个在解决数据隐私问题的同时实施机器学习的有希望的方法,通常涉及大量无线移动设备以收集示范培训数据,在这种情况下,FL预计将在资源有限的情况下满足严格的培训长期要求,如对无线带宽的需求、电力消耗和参与装置的计算限制等有限资源;出于实际考虑,FL选择一部分设备参加每次迭代的示范培训进程。因此,高效资源管理和装置选择的任务将对FL的实际使用产生重大影响。在本文件中,我们提议建立一个频谱分配优化机制,以加强无线移动网络的FL。具体地说,拟议的频谱分配优化机制在考虑个人参与装置的能源消耗、电力消耗和参与装置的计算限制的同时,最大限度地减少FL的延迟时间。为此,为确保FL的快速融合,还提议一项强有力的设备选择,以帮助FL迅速达到趋同,特别是当拟议的FL系统配置频谱优化后,不能够独立地使用最佳方式分配。