With the development and the increasing interests in ML/DL fields, companies are eager to apply Machine Learning/Deep Learning approaches to increase service quality and customer experience. Federated Learning was implemented as an effective model training method for distributing and accelerating time-consuming model training while protecting user data privacy. However, common Federated Learning approaches, on the other hand, use a synchronous protocol to conduct model aggregation, which is inflexible and unable to adapt to rapidly changing environments and heterogeneous hardware settings in real-world scenarios. In this paper, we present an approach to real-time end-to-end Federated Learning combined with a novel asynchronous model aggregation protocol. Our method is validated in an industrial use case in the automotive domain, focusing on steering wheel angle prediction for autonomous driving. Our findings show that asynchronous Federated Learning can significantly improve the prediction performance of local edge models while maintaining the same level of accuracy as centralized machine learning. Furthermore, by using a sliding training window, the approach can minimize communication overhead, accelerate model training speed and consume real-time streaming data, proving high efficiency when deploying ML/DL components to heterogeneous real-world embedded systems.
翻译:随着ML/DL领域的发展和日益增长的兴趣,各公司渴望采用机械学习/深入学习方法来提高服务质量和客户经验,采用联邦学习作为有效的示范培训方法,用于分发和加快耗时模式培训,同时保护用户数据隐私,但联邦学习共同方法则使用同步程序进行模型汇总,这种程序不灵活,无法适应现实世界情景中迅速变化的环境和多种硬件环境。在本文件中,我们提出了一个实时端到端的联邦学习方法,加上一个新的非同步模式汇总协议。我们的方法在汽车领域的工业使用案件中得到验证,重点是自主驱动车轮角度预测。我们的研究结果显示,非同步联邦学习可以大大改进本地边际模型的预测性能,同时保持与中央机器学习的准确性水平。此外,通过使用滑动式培训窗口,这种方法可以最大限度地减少通信费,加快模型培训速度,并消耗实时流数据,在将ML/DL组件部署到真实世界嵌入系统时证明效率很高。