Recently, deep learning-based methods have drawn huge attention due to their simple yet high performance without domain knowledge in sound classification and localization tasks. However, a lack of gun sounds in existing datasets has been a major obstacle to implementing a support system to spot criminals from their gunshots by leveraging deep learning models. Since the occurrence of gunshot is rare and unpredictable, it is impractical to collect gun sounds in the real world. As an alternative, gun sounds can be obtained from an FPS game that is designed to mimic real-world warfare. The recent FPS game offers a realistic environment where we can safely collect gunshot data while simulating even dangerous situations. By exploiting the advantage of the game environment, we construct a gunshot dataset, namely BGG, for the firearm classification and gunshot localization tasks. The BGG dataset consists of 37 different types of firearms, distances, and directions between the sound source and a receiver. We carefully verify that the in-game gunshot data has sufficient information to identify the location and type of gunshots by training several sound classification and localization baselines on the BGG dataset. Afterward, we demonstrate that the accuracy of real-world firearm classification and localization tasks can be enhanced by utilizing the BGG dataset.
翻译:最近,深层次的学习方法因其简单而高的性能而引起人们的极大关注,因为它们在可靠的分类和本地化任务方面没有可靠的域知识,因此其表现是简单而高的;然而,现有数据集中缺乏枪声,是利用深层次学习模式实施一个支持系统,通过使用深层次学习模式从枪声中发现罪犯的枪声的主要障碍;由于枪声是罕见和不可预测的,因此在现实世界中收集枪声是不切实际的;作为替代办法,可以从一个旨在模仿现实世界战争的FPS游戏中获取枪声。最近的FPS游戏提供了一个现实的环境,使我们能够安全地收集枪声数据,同时模拟甚至危险的情况。我们利用游戏环境的优势,为枪支分类和本地化任务建立一个枪声数据集,即BGGG,即BGG。 BG数据集由37种不同的火器、距离和声音源与接收者之间的方向组成。我们仔细核实,游戏中的枪声声数据足以识别射击的地点和类型,通过在BGGG数据集上培训几个健全的分类和本地化基线。随后,我们证明现实世界火器分类和本地化任务的准确性任务可以通过BGGGS来增强数据。