Deep Neural Networks (DNNs) are built using artificial neural networks. They are part of machine learning methods that are capable of learning from data that have been used in a wide range of applications. DNNs are mainly handcrafted and they usually contain numerous layers. Research frontier has emerged that concerns automated construction of DNNs via evolutionary algorithms. This paper emphasizes the importance of what we call two-dimensional brain evolution and how it can inspire two dimensional DNN evolutionary modeling. We also highlight the connection between the dropout method which is widely-used in regularizing DNNs and neurogenesis of the brain, and how these concepts could benefit DNNs evolution.The paper concludes with several recommendations for enhancing the automatic construction of DNNs.
翻译:深度神经网络(DNN)是使用人工神经网络搭建的机器学习方法,在广泛的应用中可从数据中学习。 DNN主要是手工制作的,通常包含许多层。当前前沿研究关注如何通过进化算法自动构建DNN。本文强调了我们所称的二维脑进化的重要性,以及如何启发二维DNN进化建模。我们还强调了在DNN中广泛使用的辍学方法(即dropout)与大脑神经发生的联系以及这些概念如何有助于DNN进化。本文最后提出了几项增强自动构建DNN的建议。