Is intelligence realized by connectionist or classicist? While connectionist approaches have achieved superhuman performance, there has been growing evidence that such task-specific superiority is particularly fragile in systematic generalization. This observation lies in the central debate between connectionist and classicist, wherein the latter continually advocates an algebraic treatment in cognitive architectures. In this work, we follow the classicist's call and propose a hybrid approach to improve systematic generalization in reasoning. Specifically, we showcase a prototype with algebraic representation for the abstract spatial-temporal reasoning task of Raven's Progressive Matrices (RPM) and present the ALgebra-Aware Neuro-Semi-Symbolic (ALANS) learner. The ALANS learner is motivated by abstract algebra and the representation theory. It consists of a neural visual perception frontend and an algebraic abstract reasoning backend: the frontend summarizes the visual information from object-based representation, while the backend transforms it into an algebraic structure and induces the hidden operator on the fly. The induced operator is later executed to predict the answer's representation, and the choice most similar to the prediction is selected as the solution. Extensive experiments show that by incorporating an algebraic treatment, the ALANS learner outperforms various pure connectionist models in domains requiring systematic generalization. We further show the generative nature of the learned algebraic representation; it can be decoded by isomorphism to generate an answer.
翻译:情报是由联系主义者或经典主义者实现的吗?尽管联系主义者的方法已经实现了超人性的表现?尽管联系主义者的方法已经实现了超人性的表现,但越来越多的证据表明,这种任务特有的优越性在系统性的概括化中特别脆弱。这种观察存在于联系主义者和经典主义者之间的中心辩论之中,后者不断主张认知结构中的代数处理。在这项工作中,我们遵循经典主义者的号召,并提议一种混合方法来改进理性的系统化概括化。具体地说,我们展示了一个具有代数代表的原型,用于雷文进步马斯特的抽象空间时空推理任务,并正在展示远方的ALME-Aware Neuro-Semi-Symbolic(ALNS)学习者。ALANS的学习者受到抽象的代数和代数学理论的驱动。它包括一个神经视觉前视端和代数的抽象推理推理:前端概述了基于对象的表达的视觉信息,而后端将它转换成一个代数结构结构,并引出隐蔽的操作者。随后,我们执行的操作者将预测了一种系统化的变形的变形的变形的变形模型,将显示一个系统化的变形变形的变形的变形的变形的变形的变形模型,将显示了一种变形的变形的变形的变形模型的变形的变形的变形的变形的变形的变形的变形模型。