This paper presents the design, implementation, and evaluation of FLSys, a mobile-cloud federated learning (FL) system that supports deep learning models for mobile apps. FLSys is a key component toward creating an open ecosystem of FL models and apps that use these models. FLSys is designed to work with mobile sensing data collected on smart phones, balance model performance with resource consumption on the phones, tolerate phone communication failures, and achieve scalability in the cloud. In FLSys, different DL models with different FL aggregation methods in the cloud can be trained and accessed concurrently by different apps. Furthermore, FLSys provides a common API for third-party app developers to train FL models. FLSys is implemented in Android and AWS cloud. We co-designed FLSys with a human activity recognition (HAR) in the wild FL model. HAR sensing data was collected in two areas from the phones of 100+ college students during a five-month period. We implemented HAR-Wild, a CNN model tailored to mobile devices, with a data augmentation mechanism to mitigate the problem of non-Independent and Identically Distributed (non-IID) data that affects FL model training in the wild. A sentiment analysis (SA) model is used to demonstrate how FLSys effectively supports concurrent models, and it uses a dataset with 46,000+ tweets from 436 users. We conducted extensive experiments on Android phones and emulators showing that FLSys achieves good model utility and practical system performance.
翻译:本文介绍了FLSys的设计、实施和评估情况,FLSys是一个支持移动应用程序深度学习模型的移动式混合学习(FLS)系统。FLSys是创建使用这些模型的FLS模型和应用软件的开放生态系统的关键组成部分。FLSys旨在利用在智能手机上收集的移动遥感数据,平衡模型性能与电话资源消耗的平衡模型性能,容忍电话通信故障,并在云层中实现可缩放。在FLSyssys中,不同软件可以同时培训和访问云层中不同FL(FL)集成方法的不同DLS模型。此外,FLSyssys为第三方应用程序开发者培训FL模式和应用这些模型提供了共同的API。在Android和AWS云中实施FLSysy。我们在野外FL模型中共同设计了具有人类活动识别力的FLSy(H)系统。HAR遥感数据数据是在100+大学学生的手机模型中收集的两个领域的两个领域。我们实施了一个CN-Wild模型,用来适应移动设备,该模型,用一个数据扩增量机制,用ADLSLSA(我们使用了不常态数据分析的模型来有效分析,以演示A-SA-SAxxxxxxx)。