Federated learning (FL) is an emerging machine learning paradigm, in which data owners can collaboratively train a model without sharing their raw data. Two fundamental research problems in FL are the incentive mechanism and privacy protection. The former focuses on how to incentivize data owners to participate in FL. The latter studies how to protect data owners' privacy while maintaining high utility of trained models. However, the incentive mechanism and privacy protection in FL have been studied separately, and no work simultaneously solves both problems. In this work, we address the two problems simultaneously with FL-Market, which incentivizes data owners' participation by providing appropriate payments and privacy protection. FL-Market enables data owners to obtain compensation according to their privacy loss quantified by local differential privacy (LDP). Our insight is that by meeting data owners' personalized privacy preferences and providing appropriate payments, we can (1) incentivize privacy risk-tolerant data owners to set larger privacy parameters (i.e., gradients with less noise) and (2) provide preferred privacy protection for privacy risk-averse data owners. To achieve this, we design a personalized LDP-based FL framework with a deep learning-empowered auction mechanism to incentivize trading private models with less noise and an optimal aggregation mechanism for aggregating local gradients into an accurate global gradient. Our experiments verify the effectiveness of the proposed framework and mechanisms.
翻译:联邦学习(FL)是一个新兴的机器学习模式,数据所有者可以在不分享原始数据的情况下合作培训一个模型。FL的两个根本性研究问题是激励机制和隐私保护。前者侧重于如何激励数据所有者参加FL。后者研究如何保护数据所有者隐私,同时保持训练有素的模型的高度效用。然而,FL的激励机制和隐私保护是分开研究的,没有同时解决这两个问题。在这项工作中,数据所有者可以与FL-市场同时合作,通过提供适当的付款和隐私保护来激励数据所有者参与这两个问题。FL-市场使数据所有者能够根据当地差异隐私权(LDP)量化的隐私损失获得补偿。我们的洞察力是,通过满足数据所有者的个人隐私偏好和适当支付的方式,保护数据所有人保护数据所有人隐私的激励机制和隐私不受风险保护没有同时解决这两个问题。在这项工作中,我们与FLD-Market同时解决了两个问题,通过提供适当的支付和隐私风险保护所有人参与。为了实现这一目标,我们设计了一个以个人化的LDP-DP-FL框架的个人贸易化的准确性升级框架,在深度学习机制下,将一个以最佳的FLIGlistal-listallistal vilal vilusildal vilildildildildildildildildildildildildildildildildildildildildildildildildildildildildildildildildildildildildildildildildildildildildildildildildildildildildil,我们可以设计一个个人交易一个个人交易一个个人交易一个个人交易一个个人交易机制,一个个人交易和深的升级机制,一个个人交易和深的升级框架,一个深的升级机制,我们以一个深级的升级机制,我们将一个深级框架,我们设计框架,我们设计的精确级的升级机制,我们将一个最低级的精确级的精确级的精确级的精确级的升级机制,我们设计的精确级框架,我们设计的精确级的精确级的精确级框架,我们能级的精确级框架,我们设计的