Federated Learning (FL) over wireless network enables data-conscious services by leveraging the ubiquitous intelligence at network edge for privacy-preserving model training. As the proliferation of context-aware services, the diversified personal preferences causes disagreeing conditional distributions among user data, which leads to poor inference performance. In this sense, clustered federated learning is proposed to group user devices with similar preference and provide each cluster with a personalized model. This calls for innovative design in edge association that involves user clustering and also resource management optimization. We formulate an accuracy-cost trade-off optimization problem by jointly considering model accuracy, communication resource allocation and energy consumption. To comply with parameter encryption techniques in FL, we propose an iterative solution procedure which employs deep reinforcement learning based approach at cloud server for edge association. The reward function consists of minimized energy consumption at each base station and the averaged model accuracy of all users. Under our proposed solution, multiple edge base station are fully exploited to realize cost efficient personalized federated learning without any prior knowledge on model parameters. Simulation results show that our proposed strategy outperforms existing strategies in achieving accurate learning at low energy cost.
翻译:在无线网络之上的联邦学习(FL)通过利用网络边缘的无处不在的智能进行隐私保护模式培训,使具有数据意识的服务成为了数据意识的服务。随着环境意识服务的扩散,个人偏好的多样性导致用户数据中有条件分布不尽相同,从而导致推论性差。从这个意义上讲,向具有类似偏好的用户组群提议分组联邦学习,为每个组群提供个性化模式。这要求在边缘协会中进行创新设计,涉及用户群群和资源管理优化。我们通过共同考虑模型准确性、通信资源分配和能源消耗,制定了准确性成本权衡优化问题。为了遵守FL的参数加密技术,我们提议了一个迭代解决方案程序,在边缘服务器上采用基于深度强化学习的方法。奖励功能包括尽量减少每个基站的能源消耗,以及所有用户的平均模型准确性。根据我们提议的解决方案,多边基站被充分利用以实现成本高效的个人化节能学习,而不事先了解模型参数。模拟结果显示,我们拟议的战略在以低能源成本实现准确学习方面优于现有战略。