We report the result of the first edition of the WMT shared task on Translation Suggestion (TS). The task aims to provide alternatives for specific words or phrases given the entire documents generated by machine translation (MT). It consists two sub-tasks, namely, the naive translation suggestion and translation suggestion with hints. The main difference is that some hints are provided in sub-task two, therefore, it is easier for the model to generate more accurate suggestions. For sub-task one, we provide the corpus for the language pairs English-German and English-Chinese. And only English-Chinese corpus is provided for the sub-task two. We received 92 submissions from 5 participating teams in sub-task one and 6 submissions for the sub-task 2, most of them covering all of the translation directions. We used the automatic metric BLEU for evaluating the performance of each submission.
翻译:我们报告WMT关于翻译建议(TS)共同任务的第一版的结果。任务的目的是为机器翻译产生的整个文件提供具体词或词句的替代物。它由两个子任务组成,即天真翻译建议和带有提示的翻译建议。主要区别在于,在子任务二中提供了一些提示,因此,模型更容易产生更准确的建议。关于子任务一,我们为英语-德语和英语-中文对等语言提供了保护体。只有次任务二提供了英文-中文保护体。我们收到了5个参与小组提交的分任务一和6分任务二的92份材料,其中多数涉及所有翻译方向。我们使用自动BLEU来评价每份提交材料的绩效。