Federated Deep Learning (FDL) is helping to realize distributed machine learning in the Internet of Vehicles (IoV). However, FDL's global model needs multiple clients to upload learning model parameters, thus still existing unavoidable communication overhead and data privacy risks. The recently proposed Swarm Learning (SL) provides a decentralized machine-learning approach uniting edge computing and blockchain-based coordination without the need for a central coordinator. This paper proposes a Swarm-Federated Deep Learning framework in the IoV system (IoV-SFDL) that integrates SL into the FDL framework. The IoV-SFDL organizes vehicles to generate local SL models with adjacent vehicles based on the blockchain empowered SL, then aggregates the global FDL model among different SL groups with a proposed credibility weights prediction algorithm. Extensive experimental results demonstrate that compared with the baseline frameworks, the proposed IoV-SFDL framework achieves a 16.72% reduction in edge-to-global communication overhead while improving about 5.02% in model performance with the same training iterations.
翻译:联邦深层学习组织(FDL)正在帮助在车辆互联网上实现分布式机器学习。然而,FDL的全球模型需要多个客户上传学习模型参数,从而仍然存在不可避免的通信间接费用和数据隐私风险。最近提出的Swarm Learning(SL)提供了一种分散式机器学习方法,将边缘计算和链式协调结合起来,而不需要中央协调员。本文件建议在IOV系统(IOV-SFDL)中建立一个Swarm-FIDL深层学习框架,将SL纳入FDL框架。IOV-SFDL组织车辆,以基于已获得权能的链条为基础,用相邻车辆生成本地SL(SL)模型,然后将全球FDL模型汇总到不同的SL组组中,提出可信的加权预测算法。广泛的实验结果显示,与基准框架相比,拟议的IOV-SDDL框架在将边际通信间接费用减少16.72%,同时用同样的培训模式改进了大约5.02 %。