Federated learning has a variety of applications in multiple domains by utilizing private training data stored on different devices. However, the aggregation process in federated learning is highly vulnerable to adversarial attacks so that the global model may behave abnormally under attacks. To tackle this challenge, we present a novel aggregation algorithm with residual-based reweighting to defend federated learning. Our aggregation algorithm combines repeated median regression with the reweighting scheme in iteratively reweighted least squares. Our experiments show that our aggregation algorithm outperforms other alternative algorithms in the presence of label-flipping, backdoor, and Gaussian noise attacks. We also provide theoretical guarantees for our aggregation algorithm.
翻译:联邦学习在多个领域有多种应用,利用储存在不同装置上的私人培训数据。然而,联邦学习的汇总过程极易受到对抗性攻击的伤害,因此全球模型可能会在攻击下异常地运作。为了应对这一挑战,我们提出了一个新的汇总算法,其中含有基于残余的再加权,以捍卫联邦学习。我们的汇总算法将重复的中位回归与迭代再加权最低平方的再加权计划结合起来。我们的实验显示,我们的汇总算法在标签反侧、后门和高斯语噪音攻击的情况下,优于其他替代算法。我们还为我们的汇总算法提供理论保障。