We are proposing fully parallel and maximally distributed hardware realization of a generic neuro-computing system. More specifically, the proposal relates to the wireless sensor networks technology to serve as a massively parallel and fully distributed hardware platform to implement and realize artificial neural network (ANN) algorithms. A parallel and distributed (PDP) hardware realization of ANNs makes it possible to have real time computation of large-scale (and complex) problems in a highly robust framework. We will demonstrate how a network of hundreds of thousands of processing nodes (or motes of a wireless sensor network), which have on-board processing and wireless communication features, can be used to implement fully parallel and massively distributed computation of artificial neural network algorithms for solution of truly large-scale problems in real time. The realization of artificial neural network algorithms in a massively parallel and fully distributed hardware has been the goal of neural network computing researchers. This is because a parallel and distributed computation of artificial neural network algorithms could not have been achieved against all the advancements in silicon- or optics-based computing. Accordingly, artificial neural networks could not be applied to very large-scale problems for real time computation of solutions. This hindered the development of neural algorithms for affordable and practical solutions of challenging problems since often special-purpose computing approaches in hardware, software or hybrid (non-neural) had to be developed for and fine-tuned to specific problems that are very large-scale and highly complex. Successful implementation is likely to revolutionize computing as we know it by making it possible to solve very large scale scientific, engineering or technical problems in real time.
翻译:我们提出了一种完全并行且最大程度分布式的通用神经计算系统硬件实现方案。具体而言,该方案利用无线传感器网络技术作为大规模并行、完全分布式的硬件平台,以实施和实现人工神经网络(ANN)算法。人工神经网络的并行分布式(PDP)硬件实现使得在高度鲁棒的框架下对大规模(及复杂)问题进行实时计算成为可能。我们将展示如何利用具备板载处理与无线通信功能的数十万个处理节点(即无线传感器网络的传感器节点)网络,实现人工神经网络算法的完全并行与大规模分布式计算,从而实时解决真正的大规模问题。在大规模并行、完全分布式硬件中实现人工神经网络算法一直是神经网络计算研究者的目标。这是因为尽管基于硅基或光学的计算技术取得了诸多进展,人工神经网络算法的并行分布式计算仍难以实现。因此,人工神经网络无法应用于需要实时计算解决方案的超大规模问题。这阻碍了针对可负担且实用的挑战性问题开发神经算法的发展,因为通常需要针对特定的大规模复杂问题,开发并优化专用的硬件、软件或混合(非神经)计算方法。该方案的成功实施有望通过实现超大规模科学、工程或技术问题的实时求解,彻底变革现有计算范式。