Federated Learning (FL) has recently emerged as a popular solution to distributedly train a model on user devices improving user privacy and system scalability. Major Internet companies have deployed FL in their applications for specific use cases (e.g., keyboard prediction or acoustic keyword trigger), and the research community has devoted significant attention to improving different aspects of FL (e.g., accuracy, privacy, efficiency). However, there is still a lack of a practical system to enable easy collaborative cross-silo FL training, in the context of mobile environments. In this work, we bridge this gap and propose FLaME, an end-to-end system (i.e., client-side framework and libraries, and central server) to enable intra- and inter-app training on mobile devices with different types of IID and NonIID data distributions, in a secure and easy to deploy fashion. Our design solves major technical challenges such as on-device training, secure and private single and cross-app model training, while being offered in an "as a service" model. We implement FLaME for Android devices and experimentally evaluate its performance in-lab and in-wild, on more than 140 users for over a month. Our results show the feasibility and benefits of the design in a realistic mobile context and provide several insights to the FL community on the practicality and usage of FL in the wild.
翻译:最近,联邦学习组织(FL)已成为对用户设备进行改善用户隐私和系统可扩缩性的模式进行分布式培训的流行解决方案,主要互联网公司在其应用中为具体使用案例(例如键盘预测或声控关键词触发)部署了FL,研究界对改进FL的不同方面(例如准确性、隐私、效率)给予了极大关注,然而,在移动环境中,仍然缺乏一个便于合作的跨SIlo FL培训的实用系统,在移动环境中,进行方便合作的跨SIL培训。在这项工作中,我们弥合了这一差距,并提议FLAME,即终端到终端系统(即用户框架和图书馆以及中央服务器),以便能够以安全和容易的方式对不同类型IID和非IID数据的移动设备进行内部和应用程序间培训。然而,我们的设计解决了重大的技术挑战,如安装设备培训、安全性、私人单项和交叉应用模式培训,同时提供“服务”模式。我们为Androiderity装置实施FLME,并实验性地评估其具有不同类型IL数据的移动用户在设计上和现实性地展示若干FL的成本效益。