In this work, a parameter-efficient attention module is presented for emotion classification using a limited, or relatively small, number of electroencephalogram (EEG) signals. This module is called the Monotonicity Constrained Attention Module (MCAM) due to its capability of incorporating priors on the monotonicity when converting features' Gram matrices into attention matrices for better feature refinement. Our experiments have shown that MCAM's effectiveness is comparable to state-of-the-art attention modules in boosting the backbone network's performance in prediction while requiring less parameters. Several accompanying sensitivity analyses on trained models' prediction concerning different attacks are also performed. These attacks include various frequency domain filtering levels and gradually morphing between samples associated with multiple labels. Our results can help better understand different modules' behaviour in prediction and can provide guidance in applications where data is limited and are with noises.
翻译:在这项工作中,利用有限或相对较少的电脑图信号,为情感分类提供了一种具有参数效率的注意模块,该模块被称为单调调控注意模块(MCAM),因为该模块在将特性的Gram矩阵转换成注意矩阵以更好地改进特征时,能够将单调特性的前科纳入注意矩阵。我们的实验表明,MCAM的功效与在提高主干网预测性能方面最先进的注意模块相当,同时需要较少的参数。还进行了若干与经过训练的模型对不同攻击的预测有关的敏感度分析。这些袭击包括各种频率域过滤水平和与多个标签有关的样品之间逐渐变形。我们的结果有助于更好地了解不同单元在预测中的行为,并在数据有限且有噪音的应用中提供指导。