This paper describes SciClops, a method to help combat online scientific misinformation. Although automated fact-checking methods have gained significant attention recently, they require pre-existing ground-truth evidence, which, in the scientific context, is sparse and scattered across a constantly-evolving scientific literature. Existing methods do not exploit this literature, which can effectively contextualize and combat science-related fallacies. Furthermore, these methods rarely require human intervention, which is essential for the convoluted and critical domain of scientific misinformation. SciClops involves three main steps to process scientific claims found in online news articles and social media postings: extraction, clustering, and contextualization. First, the extraction of scientific claims takes place using a domain-specific, fine-tuned transformer model. Second, similar claims extracted from heterogeneous sources are clustered together with related scientific literature using a method that exploits their content and the connections among them. Third, check-worthy claims, broadcasted by popular yet unreliable sources, are highlighted together with an enhanced fact-checking context that includes related verified claims, news articles, and scientific papers. Extensive experiments show that SciClops tackles sufficiently these three steps, and effectively assists non-expert fact-checkers in the verification of complex scientific claims, outperforming commercial fact-checking systems.
翻译:本文描述SciClops,这是帮助打击在线科学误报的一种方法。虽然自动化事实核对方法最近引起了人们的极大关注,但它们需要事先存在的地面真实证据,在科学方面,这种证据很少,分散在不断演变的科学文献中。现有的方法并不利用这种文献,这种文献可以有效地将科学相关谬误环境化并与之作斗争。此外,这些方法很少需要人手干预,而这种干预对于科学误报的复杂和关键领域至关重要。SciClops涉及处理在线新闻文章和社交媒体张贴中发现的科学主张的三个主要步骤:提取、集群和背景化。首先,利用一个特定领域、微调的变异器模型提取科学主张。第二,从多元来源提取的类似主张与相关的科学文献集中使用一种利用其内容及其相互联系的方法。第三,由大众但不可靠来源广播的可核对性主张,连同一个强化的事实核对环境,其中包括相关的经核实的主张、新闻文章和科学论文。广泛的实验显示,Sciloops 能够有效地处理这些复杂的科学主张。