In federated learning (FL), fair and accurate measurement of the contribution of each federated participant is of great significance. The level of contribution not only provides a rational metric for distributing financial benefits among federated participants, but also helps to discover malicious participants that try to poison the FL framework. Previous methods for contribution measurement were based on enumeration over possible combination of federated participants. Their computation costs increase drastically with the number of participants or feature dimensions, making them inapplicable in practical situations. In this paper an efficient method is proposed to evaluate the contributions of federated participants. This paper focuses on the horizontal FL framework, where client servers calculate parameter gradients over their local data, and upload the gradients to the central server. Before aggregating the client gradients, the central server train a data value estimator of the gradients using reinforcement learning techniques. As shown by experimental results, the proposed method consistently outperforms the conventional leave-one-out method in terms of valuation authenticity as well as time complexity.
翻译:在联合学习(FL)中,公平和准确地衡量每个联盟参与者的贡献非常重要。贡献水平不仅为向联盟参与者分配财务利益提供了合理的衡量标准,而且有助于发现试图毒化FL框架的恶意参与者。以往的缴款衡量方法基于对联盟参与者可能的组合进行查点,其计算成本随着参与者人数或特征的大小而急剧增加,使其无法适用于实际情况。在本文件中,提议了一种有效的方法来评价联盟参与者的贡献。本文件侧重于横向FL框架,客户服务器计算其本地数据上的参数梯度,并将梯度上传到中央服务器。在汇总客户梯度之前,中央服务器用强化学习技术培训梯度的数据估计符。如实验结果所示,拟议方法在估值真实性和时间复杂性方面始终超越传统的一次性休假方法。