Internet of Things (IoT) devices are becoming increasingly popular and are influencing many application domains such as healthcare and transportation. These devices are used for real-world applications such as sensor monitoring, real-time control. In this work, we look at differentially private (DP) neural network (NN) based network intrusion detection systems (NIDS) to detect intrusion attacks on networks of such IoT devices. Existing NN training solutions in this domain either ignore privacy considerations or assume that the privacy requirements are homogeneous across all users. We show that the performance of existing differentially private stochastic methods degrade for clients with non-identical data distributions when clients' privacy requirements are heterogeneous. We define a cohort-based $(\epsilon,\delta)$-DP framework that models the more practical setting of IoT device cohorts with non-identical clients and heterogeneous privacy requirements. We propose two novel continual-learning based DP training methods that are designed to improve model performance in the aforementioned setting. To the best of our knowledge, ours is the first system that employs a continual learning-based approach to handle heterogeneity in client privacy requirements. We evaluate our approach on real datasets and show that our techniques outperform the baselines. We also show that our methods are robust to hyperparameter changes. Lastly, we show that one of our proposed methods can easily adapt to post-hoc relaxations of client privacy requirements.
翻译:互联网(IoT)装置正在变得越来越受欢迎,并正在影响许多应用领域,如保健和交通。这些装置被用于实时控制传感器监测等真实世界应用。在这项工作中,我们查看基于网络入侵检测系统的差别化私人(DP)神经网络(NN)网络,以探测对互联网装置网络的入侵攻击。该领域现有的NNN培训解决方案要么忽视隐私考虑,要么假定所有用户的隐私要求是相同的。我们显示,在客户隐私要求各不相同时,现有有差异的私人随机方法的性能会退化,客户的数据分配不完全相同。我们定义了一个基于集体的$(epsilon,\delta)-DP框架,用以模拟基于互联网入侵检测系统对互联网装置网络的入侵攻击。我们提议了两种新的基于DP培训的不断学习方法,目的是改进上述环境中的模型性能。我们的知识是第一个采用不断学习的方法处理客户隐私要求的异质性。我们还在客户隐私要求方面确定了一个更精确的客户要求,我们展示了一种更精确的基线方法。我们展示了一种更精确的方法。