Knowledge graphs are essential for numerous downstream natural language processing applications, but are typically incomplete with many facts missing. This results in research efforts on multi-hop reasoning task, which can be formulated as a search process and current models typically perform short distance reasoning. However, the long-distance reasoning is also vital with the ability to connect the superficially unrelated entities. To the best of our knowledge, there lacks a general framework that approaches multi-hop reasoning in both short and long scenarios. We argue that there are two key issues for long distance reasoning: i) which edge to select, and ii) when to stop the search. In this work, we propose a general model which resolves the issues with three modules: 1) the local-global knowledge module to estimate the possible paths, 2) the differentiated action dropout module to explore a diverse set of paths, and 3) the adaptive stopping search module to avoid over searching. The comprehensive results on three datasets demonstrate the superiority of our model with significant improvements against baselines in both short and long distance reasoning scenarios.
翻译:知识图表对于许多下游自然语言处理应用程序至关重要,但通常不完全,而且缺少许多事实。这导致对多手推理任务的研究工作,可将其作为一个搜索过程,而当前模型通常具有短距离推理作用。然而,长距离推理对于将表面上无关的实体连接起来的能力也至关重要。据我们所知,缺乏一个在短期和长期情景中采用多手推理的一般框架。我们认为,存在两个长距离推理的关键问题:(一) 选择的优势,和(二) 何时停止搜索。在这项工作中,我们提出了一个一般性模型,用三个模块解决问题:(1) 估算可能路径的本地-全球知识模块,(2) 探索多种路径的有区别行动退出模块,(3) 避免过度搜索的适应性停止搜索模块。三个数据集的全面结果显示了我们模型的优越性,在短距离推理理假设中与基线的显著改进。