With the rise of Deep Learning (DL), our world braces for AI in every edge device, creating an urgent need for edge-AI SoCs. This SoC hardware needs to support high throughput, reliable and secure AI processing at Ultra Low Power (ULP), with a very short time to market. With its strong legacy in edge solutions and open processing platforms, the EU is well-positioned to become a leader in this SoC market. However, this requires AI edge processing to become at least 100 times more energy-efficient, while offering sufficient flexibility and scalability to deal with AI as a fast-moving target. Since the design space of these complex SoCs is huge, advanced tooling is needed to make their design tractable. The CONVOLVE project (currently in Inital stage) addresses these roadblocks. It takes a holistic approach with innovations at all levels of the design hierarchy. Starting with an overview of SOTA DL processing support and our project methodology, this paper presents 8 important design choices largely impacting the energy efficiency and flexibility of DL hardware. Finding good solutions is key to making smart-edge computing a reality.
翻译:随着深入学习(DL)的兴起,我们的世界在每一个边缘设备中都支持AI(DL),从而产生了对边缘AI SoC的紧急需求。这个 SoC硬件需要支持超低电(ULP)的高输送量、可靠和安全的AI处理,而且市场时间很短。由于在边缘解决方案和开放处理平台中留下大量遗产,欧盟完全有能力成为这个SoC市场的领导者。然而,这要求AI边缘处理至少提高100倍的能效,同时提供足够的灵活性和可缩放性,将AI作为一个快速移动的目标。由于这些复杂 SoCs的设计空间巨大,需要先进的工具才能使其设计具有可移动性。CONVOLVE项目(目前处于伊蒂阶段)解决了这些障碍问题。它采取整体方法,在设计层次的各个层次上进行创新。从SOTA DL(DL)处理支持和我们的项目方法的概览开始,本文提出了8项重要的设计选择,主要影响DL硬件的能源效率和灵活性。找到良好的解决方案是使智能计算成为现实的关键。