Animals can quickly learn the timing of events with fixed intervals and their rate of acquisition does not depend on the length of the interval. In contrast, recurrent neural networks that use gradient based learning have difficulty predicting the timing of events that depend on stimulus that occurred long ago. We present the latent time-adaptive drift-diffusion model (LTDDM), an extension to the time-adaptive drift-diffusion model (TDDM), a model for animal learning of timing that exhibits behavioural properties consistent with experimental data from animals. The performance of LTDDM is compared to that of a state of the art long short-term memory (LSTM) recurrent neural network across three timing tasks. Differences in the relative performance of these two models is discussed and it is shown how LTDDM can learn these events time series orders of magnitude faster than recurrent neural networks.
翻译:动物可以通过固定间隔快速了解事件的发生时间,其获取速度不取决于间隔时间长短。相反,使用梯度学习的经常性神经网络难以预测取决于很久以前发生的刺激因素的事件的发生时间。我们展示了潜伏的适应时间的漂流扩散模型(LTDDM),这是时间适应性漂流扩散模型(TDDM)的延伸,这是动物学习时间的模型,表明与动物实验数据相符的行为特性。LTDDM的性能与三种时间任务之间最先进的短期内存(LSTM)经常性神经网络的性能相比较。讨论了这两种模型相对性能的差异,并展示了LTDDMDM如何比经常性神经网络更快地了解这些事件的时间序列。