Sound event detection (SED), as a core module of acoustic environmental analysis, suffers from the problem of data deficiency. The integration of semi-supervised learning (SSL) largely mitigates such problem while bringing no extra annotation budget. This paper researches on several core modules of SSL, and introduces a random consistency training (RCT) strategy. First, a self-consistency loss is proposed to fuse with the teacher-student model to stabilize the training. Second, a hard mixup data augmentation is proposed to account for the additive property of sounds. Third, a random augmentation scheme is applied to flexibly combine different types of data augmentations. Experiments show that the proposed strategy outperform other widely-used strategies.
翻译:作为声学环境分析的一个核心模块,健康事件探测(SED)存在数据缺陷问题,将半监督学习(SSL)整合,在不产生额外注解预算的情况下,在很大程度上缓解了这类问题。本文对SSL的几个核心模块进行了研究,并引入了随机一致性培训战略。首先,建议自相矛盾的损失与师生模式相结合,以稳定培训。第二,建议硬性混和数据增强,以说明声音的添加特性。第三,随机增强计划用于灵活地将不同类型的数据增强组合在一起。实验表明,拟议的战略比其他广泛使用的战略效果要好。