Federated Edge Learning (FEL) allows edge nodes to train a global deep learning model collaboratively for edge computing in the Industrial Internet of Things (IIoT), which significantly promotes the development of Industrial 4.0. However, FEL faces two critical challenges: communication overhead and data privacy. FEL suffers from expensive communication overhead when training large-scale multi-node models. Furthermore, due to the vulnerability of FEL to gradient leakage and label-flipping attacks, the training process of the global model is easily compromised by adversaries. To address these challenges, we propose a communication-efficient and privacy-enhanced asynchronous FEL framework for edge computing in IIoT. First, we introduce an asynchronous model update scheme to reduce the computation time that edge nodes wait for global model aggregation. Second, we propose an asynchronous local differential privacy mechanism, which improves communication efficiency and mitigates gradient leakage attacks by adding well-designed noise to the gradients of edge nodes. Third, we design a cloud-side malicious node detection mechanism to detect malicious nodes by testing the local model quality. Such a mechanism can avoid malicious nodes participating in training to mitigate label-flipping attacks. Extensive experimental studies on two real-world datasets demonstrate that the proposed framework can not only improve communication efficiency but also mitigate malicious attacks while its accuracy is comparable to traditional FEL frameworks.
翻译:联邦远距学习(FEL)允许边缘节点来训练全球深层次学习模型,以便在工业物业互联网(IIoT)中进行边际计算,这极大地促进了工业用4.0的开发。然而,FEL面临两大挑战:通信间接费用和数据隐私。FEL在培训大型多节点模型时面临着昂贵的通信间接费用。此外,由于FEL容易受到梯度渗漏和标签滑动攻击,全球模型的培训过程很容易受到对手的损害。为了应对这些挑战,我们提议为IIoT的边端计算建立一个通信效率和隐私强化的私隐私隐私密FEL框架。首先,我们推出一个无序模式更新计划,以减少边端节点等待全球模型集成的计算时间。第二,我们提议建立一个无序的本地差异隐私机制,通过在边缘节点的梯度梯度上添加精心设计的噪音,来减少梯度渗漏。我们设计一个云端恶意节点检测机制,通过测试本地模型质量来探测恶意的节点。这种机制可以避免在进行真正的实验性攻击时进行模拟性训练,而不能在进行真正的实验性标签上证明。