A mass of data transfer between the processing and storage units has been the leading bottleneck in modern Von-Neuman computing systems, especially when used for Artificial Intelligence (AI) tasks. Computing-in-Memory (CIM) has shown great potential to reduce both latency and power consumption. However, the conventional analog CIM schemes are suffering from reliability issues, which may significantly degenerate the accuracy of the computation. Recently, CIM schemes with digitized input data and weights have been proposed for high reliable computing. However, the properties of the digital memory and input data are not fully utilized. This paper presents a novel low power CIM scheme to further reduce the power consumption by using a Modified Radix-4 (M-RD4) booth algorithm at the input and a Modified Canonical Signed Digit (M-CSD) for the network weights. The simulation results show that M-Rd4 and M-CSD reduce the ratio of $1\times1$ by 78.5\% on LeNet and 80.2\% on AlexNet, and improve the computing efficiency by 41.6\% in average. The computing-power rate at the fixed-point 8-bit is 60.68 TOPS/s/W.
翻译:在现代Von-Neuman计算系统中,特别是用于人工智能(AI)任务时,处理和储存单位之间的大量数据传输一直是现代Von-Neuman计算系统的主要瓶颈,特别是用于人工智能(AI)系统中的数据传输。econto-in-Memory(CIM)已经显示出巨大的潜力,可以减少潜伏和电力消耗;然而,传统的模拟CIM计划存在可靠性问题,可能大大降低计算准确性。最近,为高可靠计算提出了具有数字化输入数据和重量的CIM计划;然而,数字内存和输入数据的特性没有得到充分利用。本文提出了一个新型的低功率CIM计划,通过在输入时使用M-RD4(M-RD4)移动式拉迪迪克斯(M-CSDID)机组算法进一步降低电力消耗量。模拟结果表明,M-Rd4和M-CSDM(M-CSDM)的计算结果显示,在LeNet和AlexNet上将1 times1美元的比率降低78.5 ⁇ 和80.2 ⁇,平均将计算效率提高41.6 ⁇ 。