In this paper we explore whether the fundamental tool of experimental psychology, the behavioral experiment, has the power to generate insight not only into humans and animals, but artificial systems too. We apply the techniques of experimental psychology to investigating catastrophic forgetting in neural networks. We present a series of controlled experiments with two-layer ReLU networks, and exploratory results revealing a new understanding of the behavior of catastrophic forgetting. Alongside our empirical findings, we demonstrate an alternative, behavior-first approach to investigating neural network phenomena.
翻译:在本文中,我们探讨实验心理学的基本工具,即行为实验, 是否有能力不仅对人和动物,而且对人造系统产生洞察力。我们运用实验心理学技术来调查神经网络中的灾难性遗忘。我们展示了一系列由两层ReLU网络控制的实验,以及揭示对灾难性遗忘行为的新理解的探索性结果。除了我们的经验性调查结果外,我们还展示了一种调查神经网络现象的替代的、行为第一的方法。