Deep learning (DL) has recently changed the development of intelligent systems and is widely adopted in many real-life applications. Despite their various benefits and potentials, there is a high demand for DL processing in different computationally limited and energy-constrained devices. It is natural to study game-changing technologies such as Binary Neural Networks (BNN) to increase deep learning capabilities. Recently remarkable progress has been made in BNN since they can be implemented and embedded on tiny restricted devices and save a significant amount of storage, computation cost, and energy consumption. However, nearly all BNN acts trade with extra memory, computation cost, and higher performance. This article provides a complete overview of recent developments in BNN. This article focuses exclusively on 1-bit activations and weights 1-bit convolution networks, contrary to previous surveys in which low-bit works are mixed in. It conducted a complete investigation of BNN's development -from their predecessors to the latest BNN algorithms/techniques, presenting a broad design pipeline and discussing each module's variants. Along the way, it examines BNN (a) purpose: their early successes and challenges; (b) BNN optimization: selected representative works that contain essential optimization techniques; (c) deployment: open-source frameworks for BNN modeling and development; (d) terminal: efficient computing architectures and devices for BNN and (e) applications: diverse applications with BNN. Moreover, this paper discusses potential directions and future research opportunities in each section.
翻译:深层学习(DL)最近改变了智能系统的开发,并被广泛用于许多现实应用。尽管这些应用具有各种好处和潜力,但对于不同计算有限和能源限制装置的DL处理需求很大,因此对不同计算有限和能源限制装置的DL处理需求很大。研究Binary Neal网络(BNN)等游戏改变技术,以提高深层学习能力是自然的。BNN公司最近取得了显著进展,因为这些技术可以实施并嵌入小型限制装置,节省了大量储存、计算成本和能源消耗。然而,几乎所有BNN公司都以额外的记忆、计算成本和更高的性能进行贸易。这篇文章全面概述了BNN公司最近的发展动态。这一文章专门侧重于1位启动和重量1位革命网络,而以前的调查则把低位工程混杂在一起。BNNNN公司的发展――从其前身到最新的BNNN的算法/技术,提出了广泛的设计管道,并讨论了每个模块的变式。与此同时,它审查了BNNN(a) BNN(c)目的:其早期成功之处和挑战是其未来应用方式;B级结构;B(b)含有基本结构;B级结构;B级结构;B级结构;B级结构;B级的选定结构;B级结构;B级结构;B级结构;B级结构;B级结构;B级结构;B级结构;B级结构;B级;B级;B级;B级;B级;B级;B级;B级;B级;B级。</s>