Raven's Progressive Matrices have been widely used for measuring abstract reasoning and intelligence in humans. However for artificial learning systems, abstract reasoning remains a challenging problem. In this paper we investigate how neural networks augmented with biologically inspired spiking modules gain a significant advantage in solving this problem. To illustrate this, we first investigate the performance of our networks with supervised learning, then with unsupervised learning. Experiments on the RAVEN dataset show that the overall accuracy of our supervised networks surpass human-level performance, while our unsupervised networks significantly outperform existing unsupervised methods. Finally, our results from both supervised and unsupervised learning illustrate that, unlike their non-augmented counterparts, networks with spiking modules are able to extract and encode temporal features without any explicit instruction, do not heavily rely on training data, and generalise more readily to new problems. In summary, the results reported here indicate that artificial neural networks with spiking modules are well suited to solving abstract reasoning.
翻译:雷文的“进步矩阵”被广泛用于测量人类的抽象推理和智能。然而,对于人工学习系统来说,抽象推理仍是一个棘手的问题。在本文中,我们调查的是神经网络与生物启发弹跳模块的增强如何在解决这一问题中获得重大优势。为了说明这一点,我们首先调查我们的网络在有监督的学习,然后是无监督的学习。RAVEN数据集的实验表明,我们所监督的网络的总体准确性超过了人类的性能,而我们不受监督的网络则大大超过现有的不受监督的方法。最后,我们从受监督的和不受监督的学习中获得的结果表明,与非强化的对应方不同的是,具有喷射模块的网络能够在没有任何明确指示的情况下提取和编码时空特征,并不严重依赖培训数据,而是更容易地概括新的问题。简而言之,这里报告的结果表明,带有跳动模块的人工神经网络非常适合解决抽象的推理。