Deep Neural Networks (DNNs) are built using artificial neural networks. They are part of machine learning methods that are capable of learning from data that have been used in a wide range of applications. DNNs are mainly handcrafted and they usually contain numerous layers. Research frontier has emerged that concerns automated construction of DNNs via evolutionary algorithms. This paper emphasizes the importance of what we call two-dimensional brain evolution and how it can inspire two dimensional DNN evolutionary modeling. We also highlight the connection between the dropout method which is widely-used in regularizing DNNs and neurogenesis of the brain, and how these concepts could benefit DNNs evolution.The paper concludes with several recommendations for enhancing the automatic construction of DNNs.
翻译:深度神经网络(DNN)是使用人工神经网络构建的一种机器学习方法,能够学习广泛应用的数据。DNN通常都是手工设计的,含有许多层。现在有研究关注通过进化算法实现DNN自动构建。本文强调了所谓的二维脑演化的重要性,以及其如何启发二维DNN演化建模。我们还强调了常用于正则化DNN的dropout方法和神经元再生之间的联系,以及这些概念如何有益于DNN的演化。本文最后提出了加强DNN自动构建的几点建议。