Knowledge graphs are widely used in industrial applications, making error detection crucial for ensuring the reliability of downstream applications. Existing error detection methods often fail to effectively utilize fine-grained subgraph information and rely solely on fixed graph structures, while also lacking transparency in their decision-making processes, which results in suboptimal detection performance. In this paper, we propose a novel Multi-Agent framework for Knowledge Graph Error Detection (MAKGED) that utilizes multiple large language models (LLMs) in a collaborative setting. By concatenating fine-grained, bidirectional subgraph embeddings with LLM-based query embeddings during training, our framework integrates these representations to produce four specialized agents. These agents utilize subgraph information from different dimensions to engage in multi-round discussions, thereby improving error detection accuracy and ensuring a transparent decision-making process. Extensive experiments on FB15K and WN18RR demonstrate that MAKGED outperforms state-of-the-art methods, enhancing the accuracy and robustness of KG evaluation. For specific industrial scenarios, our framework can facilitate the training of specialized agents using domain-specific knowledge graphs for error detection, which highlights the potential industrial application value of our framework. Our code and datasets are available at https://github.com/kse-ElEvEn/MAKGED.
翻译:知识图谱在工业应用中广泛使用,使得错误检测对于确保下游应用的可靠性至关重要。现有的错误检测方法往往未能有效利用细粒度的子图信息,仅依赖于固定的图结构,同时其决策过程缺乏透明度,导致检测性能欠佳。本文提出了一种新颖的用于知识图谱错误检测的多智能体框架(MAKGED),该框架在协作环境中利用多个大型语言模型(LLMs)。通过在训练过程中将细粒度、双向的子图嵌入与基于LLM的查询嵌入进行拼接,我们的框架整合了这些表示以生成四个专用智能体。这些智能体利用来自不同维度的子图信息进行多轮讨论,从而提高了错误检测的准确性并确保了决策过程的透明性。在FB15K和WN18RR数据集上进行的大量实验表明,MAKGED优于现有最先进的方法,提升了知识图谱评估的准确性和鲁棒性。针对特定的工业场景,我们的框架可以利用领域特定的知识图谱训练专用智能体进行错误检测,这突显了我们框架潜在的工业应用价值。我们的代码和数据集可在https://github.com/kse-ElEvEn/MAKGED获取。