Event-based sensing using dynamic vision sensors is gaining traction in low-power vision applications. Spiking neural networks work well with the sparse nature of event-based data and suit deployment on low-power neuromorphic hardware. Being a nascent field, the sensitivity of spiking neural networks to potentially malicious adversarial attacks has received very little attention so far. In this work, we show how white-box adversarial attack algorithms can be adapted to the discrete and sparse nature of event-based visual data, and to the continuous-time setting of spiking neural networks. We test our methods on the N-MNIST and IBM Gestures neuromorphic vision datasets and show adversarial perturbations achieve a high success rate, by injecting a relatively small number of appropriately placed events. We also verify, for the first time, the effectiveness of these perturbations directly on neuromorphic hardware. Finally, we discuss the properties of the resulting perturbations and possible future directions.
翻译:利用动态视觉传感器进行的事件感测在低功率视觉应用中正在获得牵引力。 Spiking神经网络在事件数据和低功率神经形态硬件上安装防护装置的稀少性质下运作良好。作为一个新生领域,喷发神经网络对潜在恶意对抗性攻击的敏感程度迄今很少受到重视。在这项工作中,我们展示了白箱对抗性攻击算法如何适应事件视觉数据离散和稀疏的性质,以及如何适应突发神经网络的连续时间设置。我们测试了N-MNIST和IBM型神经形态洞察仪的神经形态图象数据集,并展示了对抗性扰动率很高,注入了相对较少的适当位置事件。我们还首次核实了这些干扰直接对神经形态硬件的效果。最后,我们讨论了由此产生的扰动的特性和可能的未来方向。