Wrong-labeling problem and long-tail relations severely affect the performance of distantly supervised relation extraction task. Many studies mitigate the effect of wrong-labeling through selective attention mechanism and handle long-tail relations by introducing relation hierarchies to share knowledge. However, almost all existing studies ignore the fact that, in a sentence, the appearance order of two entities contributes to the understanding of its semantics. Furthermore, they only utilize each relation level of relation hierarchies separately, but do not exploit the heuristic effect between relation levels, i.e., higher-level relations can give useful information to the lower ones. Based on the above, in this paper, we design a novel Recursive Hierarchy-Interactive Attention network (RHIA) to further handle long-tail relations, which models the heuristic effect between relation levels. From the top down, it passes relation-related information layer by layer, which is the most significant difference from existing models, and generates relation-augmented sentence representations for each relation level in a recursive structure. Besides, we introduce a newfangled training objective, called Entity-Order Perception (EOP), to make the sentence encoder retain more entity appearance information. Substantial experiments on the popular (NYT) dataset are conducted. Compared to prior baselines, our RHIA-EOP achieves state-of-the-art performance in terms of precision-recall (P-R) curves, AUC, Top-N precision and other evaluation metrics. Insightful analysis also demonstrates the necessity and effectiveness of each component of RHIA-EOP.
翻译:错误标签问题和长尾关系严重影响了远程监管关系提取任务的绩效。许多研究通过选择性关注机制减轻错误标签的影响,通过引入关系等级共享知识来处理长尾关系。然而,几乎所有现有研究都忽略了以下事实:在句子中,两个实体的外观顺序有助于理解其语义。此外,它们只是分别使用关系等级关系的各个关系级别,而不是利用关系级别之间的超常效应,即,较高层次关系可以向较低层次提供有用的信息。基于上述,我们设计了一个新的精度分级跨级关注网络(RHIA),以进一步处理长尾关系,而后者是关系等级之间的超直观效应模型。从上下,它通过层传递与关系相关的信息层,这是与现有模式的最大差异,并且在循环结构中为每个关系级别生成关系曲线缩略图表表。此外,我们采用了一个新的培训目标,称为实体-跨级关注度网络网络(RHIA) 进一步处理长期关系的关系,从头级数据到前级数据库(E-OVER-IA) 更新数据。(E-ROD-S-ID-ID-ID-ID-ID-ID-I-I-S-I-I-I-I-I-I-S-S-S-S-S-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I