Hierarchical Federated Learning (HFL) is a distributed machine learning paradigm tailored for multi-tiered computation architectures, which supports massive access of devices' models simultaneously. To enable efficient HFL, it is crucial to design suitable incentive mechanisms to ensure that devices actively participate in local training. However, there are few studies on incentive mechanism design for HFL. In this paper, we design two-level incentive mechanisms for the HFL with a two-tiered computing structure to encourage the participation of entities in each tier in the HFL training. In the lower-level game, we propose a coalition formation game to joint optimize the edge association and bandwidth allocation problem, and obtain efficient coalition partitions by the proposed preference rule, which can be proven to be stable by exact potential game. In the upper-level game, we design the Stackelberg game algorithm, which not only determines the optimal number of edge aggregations for edge servers to maximize their utility, but also optimize the unit reward provided for the edge aggregation performance to ensure the interests of cloud servers. Furthermore, numerical results indicate that the proposed algorithms can achieve better performance than the benchmark schemes.
翻译:分层联邦学习(Hierarchical Federated Learning,HFL)是一种分布式机器学习范式,专为多层计算体系结构而设计,支持大规模设备模型的同时访问。为了实现高效的HFL,设计合适的激励机制以确保设备积极参与本地训练至关重要。然而,HFL的激励机制设计研究很少。在本文中,我们针对两层计算结构设计两级激励机制,以鼓励每个层次的实体参与HFL训练。在较低层次的博弈中,我们提出了一个联盟形成博弈,共同优化边缘关联和带宽分配问题,并通过提出的偏好规则获得高效的联盟分区,这可通过精确潜在博弈证明是稳定的。在较高层次的博弈中,我们设计了Stackelberg博弈算法,不仅确定边缘聚合的最佳数量以最大化其效用,还优化边缘聚合绩效提供的单位奖励,以确保云服务器的利益。此外,数值结果表明,所提出的算法可以实现比基准方案更好的性能。