As machine learning algorithms become increasingly integrated in crucial decision-making scenarios, such as healthcare, recruitment, and risk assessment, there have been increasing concerns about the privacy and fairness of such systems. Federated learning has been viewed as a promising solution for collaboratively training of machine learning models among multiple parties while maintaining the privacy of their local data. However, federated learning also poses new challenges in mitigating the potential bias against certain populations (e.g., demographic groups), as this typically requires centralized access to the sensitive information (e.g., race, gender) of each data point. Motivated by the importance and challenges of group fairness in federated learning, in this work, we propose FairFed, a novel algorithm to enhance group fairness via a fairness-aware aggregation method, which aims to provide fair model performance across different sensitive groups (e.g., racial, gender groups) while maintaining high utility. This formulation can further provide more flexibility in the customized local debiasing strategies for each client. We build our FairFed algorithm around the secure aggregation protocol of federated learning. When running federated training on widely investigated fairness datasets, we demonstrate that our proposed method outperforms the state-of-the-art fair federated learning frameworks under a high heterogeneous sensitive attribute distribution. We also investigate the performance of FairFed on naturally distributed real-life data collected from different geographical locations or departments within an organization.
翻译:随着机器学习算法日益融入关键的决策情景,如保健、招聘和风险评估等,人们日益关注这类系统的隐私和公平性,联邦学习被视为多方合作培训机器学习模式的有希望的解决办法,同时维护其当地数据的隐私,然而,联邦学习在减少对某些人口(如人口群体)的潜在偏见方面也带来了新的挑战,因为这通常要求集中获取每个数据点的敏感信息(如种族、性别),在这项工作中,受联合学习群体公平的重要性和挑战的驱使,我们提出FairFed,这是通过公平意识汇总方法提高群体公平性的新算法,目的是为不同敏感群体(如种族、性别群体)提供公平的示范性业绩,同时保持很高的效用。这种提法可以进一步为每个客户提供更灵活的本地消偏偏战略。我们围绕联邦学习安全集成规程建立我们的Fairfed算法。在进行关于广泛调查的公平性地域多样性数据分布的联邦化培训时,我们还在广泛调查的公平性地理结构内,我们展示了我们根据公平性数据分布的高标准收集的州方法。