Both non-neural and neural biological systems can learn. So rather than focusing on purely brain-like learning, efforts are underway to study learning in physical systems. Such efforts include equilibrium propagation (EP) and coupled learning (CL), which require storage of two different states-the free state and the perturbed state-during the learning process to retain information about gradients. Inspired by slime mold, we propose a new learning algorithm rooted in chemical signaling that does not require storage of two different states. Rather, the output error information is encoded in a chemical signal that diffuses into the network in a similar way as the activation/feedforward signal. The steady state feedback chemical concentration, along with the activation signal, stores the required gradient information locally. We apply our algorithm using a physical, linear flow network and test it using the Iris data set with 93% accuracy. We also prove that our algorithm performs gradient descent. Finally, in addition to comparing our algorithm directly with EP and CL, we address the biological plausibility of the algorithm.
翻译:非神经和神经生物系统都可以学习。因此,我们不注重纯粹像大脑一样的学习,而是努力在物理系统中学习。这种努力包括平衡传播(EP)和同时学习(CL),这需要储存两个不同的州——自由状态和学习过程中的动荡状态,以保存有关梯度的信息。在粘泥模型的启发下,我们提议一种新的学习算法,植根于化学信号,不需要储存两个不同的州。相反,产出错误信息被编码在一个化学信号中,该化学信号以类似于激活/前进信号的方式扩散到网络中。稳定的状态反馈化学浓度,加上激活信号,将所需的梯度信息储存在本地。我们运用一种物理的、线性流网络,并使用精确度为93%的Iris数据集进行测试。我们还证明我们的算法具有梯度下降作用。最后,除了将我们的算法与EP和CL进行直接比较外,我们还处理算法的生物概率。