We present the results of the Dravidian-CodeMix shared task held at FIRE 2021, a track on sentiment analysis for Dravidian Languages in Code-Mixed Text. We describe the task, its organization, and the submitted systems. This shared task is the continuation of last year's Dravidian-CodeMix shared task held at FIRE 2020. This year's tasks included code-mixing at the intra-token and inter-token levels. Additionally, apart from Tamil and Malayalam, Kannada was also introduced. We received 22 systems for Tamil-English, 15 systems for Malayalam-English, and 15 for Kannada-English. The top system for Tamil-English, Malayalam-English and Kannada-English scored weighted average F1-score of 0.711, 0.804, and 0.630, respectively. In summary, the quality and quantity of the submission show that there is great interest in Dravidian languages in code-mixed setting and state of the art in this domain still needs more improvement.
翻译:我们介绍了在FIRE 2021年举办的Dravidian-CodeMix共同任务的结果,该任务是在代码混合文本中对Dravidian语言的情绪分析轨迹。我们描述了任务、其组织和提交的系统。这一共同任务是继续去年在FIRE 2020年举办的Dravidian-CodeMix共同任务。今年的任务包括在内和内一级进行代码混合。此外,除了泰米尔语和马来亚拉姆语之外,还引入了Kannada语。我们收到了22个泰米尔语-英语系统、15个马利亚拉姆语-英语系统和15个Kannada英语系统。泰米尔语-英语、马利亚拉姆语-英语和坎纳达英语的顶级加权平均F1分数分别为0.711、0.804和0.630。简而言之,所提交文件的质量和数量表明,对Dravidian语在代码组合设置和该领域的艺术状况方面的兴趣很大。我们还需要进一步改进。