With the development of deep learning processors and accelerators, deep learning models have been widely deployed on edge devices as part of the Internet of Things. Edge device models are generally considered as valuable intellectual properties that are worth for careful protection. Unfortunately, these models have a great risk of being stolen or illegally copied. The existing model protections using encryption algorithms are suffered from high computation overhead which is not practical due to the limited computing capacity on edge devices. In this work, we propose a light-weight, practical, and general Edge device model Pro tection method at neuron level, denoted as EdgePro. Specifically, we select several neurons as authorization neurons and set their activation values to locking values and scale the neuron outputs as the "asswords" during training. EdgePro protects the model by ensuring it can only work correctly when the "passwords" are met, at the cost of encrypting and storing the information of the "passwords" instead of the whole model. Extensive experimental results indicate that EdgePro can work well on the task of protecting on datasets with different modes. The inference time increase of EdgePro is only 60% of state-of-the-art methods, and the accuracy loss is less than 1%. Additionally, EdgePro is robust against adaptive attacks including fine-tuning and pruning, which makes it more practical in real-world applications. EdgePro is also open sourced to facilitate future research: https://github.com/Leon022/Edg
翻译:随着深度学习处理器和加速器的发展,深度学习模型作为物联网中的一部分已经广泛部署在边缘设备上。 边缘设备模型通常被视为有价值的知识产权,值得仔细保护。不幸的是,这些模型极有风险被窃取或非法复制。使用加密算法的现有模型保护受到高计算开销的困扰,这在边缘设备的计算能力有限的情况下不实用。在本作品中,我们提出了一种轻量级,实用且通用的边缘设备模型保护方法,称为EdgePro。具体来说,我们选择多个神经元作为授权神经元,并将它们的激活值设置为锁定值,在训练过程中将神经元输出比例化为“密码”。使用这些“密码”来保护模型,确保它只能在满足“密码”条件时才能正确工作,而不是加密并存储整个模型的信息。广泛的实验结果表明,EdgePro可以在不同模式的数据集上良好地工作。EdgePro的推理时间增加仅为最先进方法的60%,而精度损失不到1%。此外,EdgePro对包括微调和修剪在内的自适应攻击具有鲁棒性,这使其在真实世界应用中更实用。 EdgePro也是开源的,以促进未来的研究:https:// github.com/Leon022/ Edg