Event cameras are inherently suitable for spikingneural networks (SNNS) and have great potential in challenging scenesdue to the advantages of bionics, asynchrony, high dynamic range, and no motion blur.However, novel data augmentations designed for event properties are required to process the unconventional output of these cameras in order to unlock their potential.In this paper, we explore the extraordinary influence of brightness variations due to event properties. Along the way, two novel data augmentation methods, lemph[EventInvert) and lemph(EventDrift) (EventID), are proposedto simulate two basic transformations of this influence.Specifically, EventID inverts or drifts events in the stream through transformationsin temporal and polar domains, thereby generating samples affected by brightness variances.Extensive experiments are carried out on the CIFAR10-DVS, N-Caltech101, and N-CARS datasets.It turns out that this simulation improves generalization by increasing the robustness of models against brightness variations.In addition, EventID is broadly effective, surpassing previous state-of-the-art performances.For example, the spiking neural network model with EventID achieves a state-of-the-art accuracy of 83.501% on the CIFAR10-DVS dataset.
翻译:事件相机本质上适合于突发网络,并且具有巨大的挑战性场景潜力,因为生物精神、无同步、高动态范围以及没有运动模糊。然而,需要为事件特性设计新的数据增强装置,以便处理这些相机的非常规输出,从而释放其潜力。在本文中,我们探讨了由于事件特性而导致的亮度变化的特殊影响。沿途,建议两种新型的数据增强方法,即莱姆弗[静电 Invert]和莱姆夫(静电),模拟这种影响的两个基本变化。 具体地说,事件ID在时间和极地的变异中发生反向或漂浮事件,从而产生受亮度差异影响的样本。在CID10-DVS、N-Caltech101和N-CARS数据集上进行了广泛的实验。结果显示,通过增加模型的稳健健性,防止亮度变异。此外,事件ID在流中具有广泛有效的、超常态性能。