Federated learning (FL) becomes popular and has shown great potentials in training large-scale machine learning (ML) models without exposing the owners' raw data. In FL, the data owners can train ML models based on their local data and only send the model updates rather than raw data to the model owner for aggregation. To improve learning performance in terms of model accuracy and training completion time, it is essential to recruit sufficient participants. Meanwhile, the data owners are rational and may be unwilling to participate in the collaborative learning process due to the resource consumption. To address the issues, there have been various works recently proposed to motivate the data owners to contribute their resources. In this paper, we provide a comprehensive review for the economic and game theoretic approaches proposed in the literature to design various schemes for stimulating data owners to participate in FL training process. In particular, we first present the fundamentals and background of FL, economic theories commonly used in incentive mechanism design. Then, we review applications of game theory and economic approaches applied for incentive mechanisms design of FL. Finally, we highlight some open issues and future research directions concerning incentive mechanism design of FL.
翻译:联邦学习(FL)变得受欢迎,在培训大型机器学习模式方面表现出巨大的潜力,而不暴露所有者原始数据。在FL,数据所有者可以根据当地数据培训ML模型,只能将模型更新而不是原始数据发送给模型所有者汇总。为了提高模型准确性和培训完成时间方面的学习绩效,必须招聘足够的参与者。与此同时,数据所有者是合理的,可能不愿意参加由于资源消耗而导致的合作学习过程。为了解决问题,最近提出了各种工作,以激励数据所有者贡献资源。在本文件中,我们全面审查了文献中提议的经济和游戏理论方法,以设计各种计划,激励数据所有者参加FL培训过程。特别是,我们首先介绍FL的基本原理和背景,即奖励机制设计中常用的经济理论。然后,我们审查FL激励机制设计中应用的游戏理论和经济方法的应用。最后,我们强调一些公开的问题和今后研究方向。