Structured information is an important knowledge source for automatic verification of factual claims. Nevertheless, the majority of existing research into this task has focused on textual data, and the few recent inquiries into structured data have been for the closed-domain setting where appropriate evidence for each claim is assumed to have already been retrieved. In this paper, we investigate verification over structured data in the open-domain setting, introducing a joint reranking-and-verification model which fuses evidence documents in the verification component. Our open-domain model achieves performance comparable to the closed-domain state-of-the-art on the TabFact dataset, and demonstrates performance gains from the inclusion of multiple tables as well as a significant improvement over a heuristic retrieval baseline.
翻译:结构性信息是自动核实事实索赔的重要知识来源,然而,目前对这项任务的大多数研究都侧重于文字数据,最近对结构化数据的少数调查是在假定每一项索赔的适当证据已经收回的情况下为封闭域设置的,本文调查对开放域环境中的结构化数据的核查,采用联合重新排序和核实模式,将核查部分的证据文件结合在一起。我们的开放域模型取得了与TabFact数据集封闭域状态相类似的性能,并表明在列入多表以及大幅度改进超常检索基线后取得了绩效收益。