Emerging device-based Computing-in-memory (CiM) has been proved to be a promising candidate for high-energy efficiency deep neural network (DNN) computations. However, most emerging devices suffer uncertainty issues, resulting in a difference between actual data stored and the weight value it is designed to be. This leads to an accuracy drop from trained models to actually deployed platforms. In this work, we offer a thorough analysis of the effect of such uncertainties-induced changes in DNN models. To reduce the impact of device uncertainties, we propose UAE, an uncertainty-aware Neural Architecture Search scheme to identify a DNN model that is both accurate and robust against device uncertainties.
翻译:事实证明,新兴的基于设备的电子计算器(CiM)是高能效深神经网络(DNN)计算的一个大有希望的候选产品,但是,大多数新兴装置都存在不确定性问题,导致实际储存的数据与设计中的重量值之间存在差异。这导致从经过培训的模型向实际部署的平台的准确性下降。在这项工作中,我们透彻分析DNN模型中这种不确定性引起的变化的影响。为了减少设备不确定性的影响,我们提议UAE,一个具有不确定性的神经结构搜索计划,以确定一个既准确又能应对设备不确定性的DNN模型。