Emergence of deep neural networks (DNNs) has raised enormous attention towards artificial neural networks (ANNs) once again. They have become the state-of-the-art models and have won different machine learning challenges. Although these networks are inspired by the brain, they lack biological plausibility, and they have structural differences compared to the brain. Spiking neural networks (SNNs) have been around for a long time, and they have been investigated to understand the dynamics of the brain. However, their application in real-world and complicated machine learning tasks were limited. Recently, they have shown great potential in solving such tasks. Due to their energy efficiency and temporal dynamics there are many promises in their future development. In this work, we reviewed the structures and performances of SNNs on image classification tasks. The comparisons illustrate that these networks show great capabilities for more complicated problems. Furthermore, the simple learning rules developed for SNNs, such as STDP and R-STDP, can be a potential alternative to replace the backpropagation algorithm used in DNNs.
翻译:深层神经网络(DNN)的出现再次引起人们对人工神经网络(ANNs)的极大关注,这些网络已成为最先进的模型,并赢得了不同的机器学习挑战。虽然这些网络受到大脑的启发,但它们缺乏生物学的可信任性,而且与大脑相比在结构上也存在差异。在很长一段时间里,它们已经围绕这些网络进行了研究,以了解大脑的动态。然而,它们在现实世界和复杂的机器学习任务中的应用有限。最近,它们在解决这些任务方面表现出巨大的潜力。由于它们的能源效率和时间动态,它们在未来的开发中有许多希望。在这项工作中,我们审查了SNNNs在图像分类任务上的结构和表现。比较表明,这些网络显示了应对更复杂问题的巨大能力。此外,为SNNes制定的简单学习规则,如STDP和R-STDP,可以成为替代DNs使用的反向分析算法的一个潜在替代办法。