One of the ultimate goals of Artificial Intelligence is to assist humans in complex decision making. A promising direction for achieving this goal is Neuro-Symbolic AI, which aims to combine the interpretability of symbolic techniques with the ability of deep learning to learn from raw data. However, most current approaches require manually engineered symbolic knowledge, and where end-to-end training is considered, such approaches are either unable to learn solutions to problems of computational complexity greater than P, or are restricted to training binary neural networks. In this paper, we introduce Neuro-Symbolic Inductive Learner (NSIL), an approach that trains a general neural network to extract latent concepts from raw data, whilst learning symbolic knowledge that maps latent concepts to target labels. The novelty of our approach is a method for biasing the learning of symbolic knowledge, based on the in-training performance of both neural and symbolic components. We evaluate NSIL on three problem domains of different complexity, including an NP-complete problem. Our results demonstrate that NSIL learns expressive knowledge, solves computationally complex problems, and achieves state-of-the-art performance in terms of accuracy and data efficiency.
翻译:人工智能的最终目的之一是帮助人类做出复杂的决策。实现该目标的一个有希望的方向是神经-双曲AI(Neuro-Symbolic AI),其目的是将象征性技术的可解释性与深层学习原始数据的能力结合起来;然而,大多数目前的方法都需要人工设计象征性知识,而当考虑端对端培训时,这些方法要么无法学习如何解决计算复杂性大于P的问题,要么局限于培训二元神经网络。在本文中,我们引入了神经-双向感应学习器(NSIL),这是一种培训一般神经网络的方法,从原始数据中提取潜在概念,同时学习绘制潜在概念图示目标标签的象征性知识。我们的方法新颖是一种基于神经和象征部分在培训中的绩效而偏重于学习象征性知识的方法。我们评估NSILL(NSIL)在三个不同复杂性的问题领域,包括NP-完成的问题。我们的结果表明,国家智能学习了明确的知识,解决计算复杂的问题,并在数据方面达到状态和效能。