Optical computing has been recently proposed as a new compute paradigm to meet the demands of future AI/ML workloads in datacenters and supercomputers. However, proposed implementations so far suffer from lack of scalability, large footprints and high power consumption, and incomplete system-level architectures to become integrated within existing datacenter architecture for real-world applications. In this work, we present a truly scalable optical AI accelerator based on a crossbar architecture. We have considered all major roadblocks and address them in this design. Weights will be stored on chip using phase change material (PCM) that can be monolithically integrated in silicon photonic processes. All electro-optical components and circuit blocks are modeled based on measured performance metrics in a 45nm monolithic silicon photonic process, which can be co-packaged with advanced CPU/GPUs and HBM memories. We also present a system-level modeling and analysis of our chip's performance for the Resnet-50V1.5, considering all critical parameters, including memory size, array size, photonic losses, and energy consumption of peripheral electronics. Both on-chip SRAM and off-chip DRAM energy overheads have been considered in this modeling. We additionally address how using a dual-core crossbar design can eliminate programming time overhead at practical SRAM block sizes and batch sizes. Our results show that a 128 x 128 proposed architecture can achieve inference per second (IPS) similar to Nvidia A100 GPU at 15.4 times lower power and 7.24 times lower area.
翻译:最近有人提议,光学计算是一个新的计算模式,以满足今后在数据中心和超级计算机中的AI/ML工作量需求。然而,迄今为止,拟议的实施将因缺乏可缩放性、足迹大和电耗高以及系统级架构不完善而受到影响,这些结构将被纳入现实世界应用的现有数据中心架构。在这项工作中,我们提出了一个基于交叉路条架构的真正可缩放的光学AI加速器。我们考虑了所有主要路障,并在设计中解决了这些路障。在芯片上将使用相位变化材料(PCM)储存在相位变化材料(PCM)中,这些材料可以单项地融入硅光谱光谱过程的过程。所有电子光学组件和电路块都以45nm单立单立度光谱光学光学过程的测量性标度为模型,这些光谱过程可以与先进的CPU/GPPS和HBM记忆库共同组合。我们为Resnet-50V1.5设计的芯片的系统级模型和分析功能表现,考虑到所有关键参数,包括内存的内径、阵列大小、阵列尺寸、阵列尺寸、阵列、阵列、光标、光谱级、光流、光流、光路段内、电机机、电流、直径、直径、直径、直径、直线、直线、直线、直线、直线、直线、直线、直径、直线、直线、直径、直径、直径、直线、直径、直线、直径、直径、直径、直线、直径、直线、直径、直径、直线、直线、直线、直线、直线、直线、直线、直线、直线、直线、直线、直线、直线、直线、直路、直路、直路、直路、直路、直路、直路、直路、直路、直路、直路、直路、直路、直路、直路、直路、直路、直路、直路、直路、直路、直路、直路、直路、直路、直路、直路、直路、直路、直路、直路、直路、直路、直路、直路、直路、直