We describe SemEval-2021 task 6 on Detection of Persuasion Techniques in Texts and Images: the data, the annotation guidelines, the evaluation setup, the results, and the participating systems. The task focused on memes and had three subtasks: (i) detecting the techniques in the text, (ii) detecting the text spans where the techniques are used, and (iii) detecting techniques in the entire meme, i.e., both in the text and in the image. It was a popular task, attracting 71 registrations, and 22 teams that eventually made an official submission on the test set. The evaluation results for the third subtask confirmed the importance of both modalities, the text and the image. Moreover, some teams reported benefits when not just combining the two modalities, e.g., by using early or late fusion, but rather modeling the interaction between them in a joint model.
翻译:我们描述了SemEval-2021任务6,即“在文本和图像中检测劝导技术:数据、说明准则、评价设置、结果和参与系统”的任务6,该任务侧重于Memes,并有三个子任务:(一) 探测文本中的技术,(二) 探测使用技术的文字范围,(三) 在整个中间,即文字和图像中探测技术,这是一项广受欢迎的任务,吸引了71个注册,22个团队最终对测试集提出了正式提交,第三个子任务的评估结果确认了两种模式、文本和图像的重要性,此外,一些小组报告说,如果不是仅仅将两种模式结合起来,例如,使用早期或晚期的融合,而是用一个联合模型来模拟它们之间的互动,则有好处。