In this paper, we provide an overview of the SV-Ident shared task as part of the 3rd Workshop on Scholarly Document Processing (SDP) at COLING 2022. In the shared task, participants were provided with a sentence and a vocabulary of variables, and asked to identify which variables, if any, are mentioned in individual sentences from scholarly documents in full text. Two teams made a total of 9 submissions to the shared task leaderboard. While none of the teams improve on the baseline systems, we still draw insights from their submissions. Furthermore, we provide a detailed evaluation. Data and baselines for our shared task are freely available at https://github.com/vadis-project/sv-ident
翻译:在本文中,我们概述了作为2022年COlinging COLING的第三次学术文件处理讲习班(学术文件处理讲习班)的一部分的SV-身份共分担的任务。在共同的任务中,向与会者提供了一句话和变量词汇,并要求他们确定在学术文件全文中的个别句子中提及哪些变量(如果有的话),两个小组共向共同任务领导板提交了9份材料。虽然这两个小组没有改进基线系统,但我们仍然从其提交的材料中汲取了深刻的见解。此外,我们还提供了详细的评估。我们共同任务的数据和基线可以免费在https://github.com/vadis-project/sv-ident查阅。