Recursive neural networks (Tree-RNNs) based on dependency trees are ubiquitous in modeling sentence meanings as they effectively capture semantic relationships between non-neighborhood words. However, recognizing semantically dissimilar sentences with the same words and syntax is still a challenge to Tree-RNNs. This work proposes an improvement to Dependency Tree-RNN (DT-RNN) using the grammatical relationship type identified in the dependency parse. Our experiments on semantic relatedness scoring (SRS) and recognizing textual entailment (RTE) in sentence pairs using SICK (Sentence Involving Compositional Knowledge) dataset show encouraging results. The model achieved a 2% improvement in classification accuracy for the RTE task over the DT-RNN model. The results show that Pearson's and Spearman's correlation measures between the model's predicted similarity scores and human ratings are higher than those of standard DT-RNNs.
翻译:基于依赖树的累进神经网络(Tree-RNNNs)基于依赖树的松动神经网络(Tree-RNNS)在模拟句的含义中普遍存在,因为它们有效捕捉了非邻居词词之间的语义关系。然而,承认用相同词词和语法的语义不同句对于树-RNNS来说仍然是一个挑战。这项工作建议利用依赖树状语法关系类型改进树树树-RNN(DT-RNN)的依赖关系。我们在语义相关评分(SRS)和在使用 SICK(包含构成知识的语义知识)数据集的对句中承认文字要求(RTE)的实验显示了令人鼓舞的结果。模型在DT-RNN模式中实现了RTE任务分类精度2%的提高。结果显示,Pearson和Spearman在模型预测的相似性评分和人类评分之间的相关度比标准DT-RNNPNS。