Signal capture stands in the forefront to perceive and understand the environment and thus imaging plays the pivotal role in mobile vision. Recent explosive progresses in Artificial Intelligence (AI) have shown great potential to develop advanced mobile platforms with new imaging devices. Traditional imaging systems based on the "capturing images first and processing afterwards" mechanism cannot meet this unprecedented demand. Differently, Computational Imaging (CI) systems are designed to capture high-dimensional data in an encoded manner to provide more information for mobile vision systems.Thanks to AI, CI can now be used in real systems by integrating deep learning algorithms into the mobile vision platform to achieve the closed loop of intelligent acquisition, processing and decision making, thus leading to the next revolution of mobile vision.Starting from the history of mobile vision using digital cameras, this work first introduces the advances of CI in diverse applications and then conducts a comprehensive review of current research topics combining CI and AI. Motivated by the fact that most existing studies only loosely connect CI and AI (usually using AI to improve the performance of CI and only limited works have deeply connected them), in this work, we propose a framework to deeply integrate CI and AI by using the example of self-driving vehicles with high-speed communication, edge computing and traffic planning. Finally, we outlook the future of CI plus AI by investigating new materials, brain science and new computing techniques to shed light on new directions of mobile vision systems.
翻译:最近人工智能(AI)的爆炸性算法已经显示出开发具有新成像装置的先进移动平台的巨大潜力。基于“先捕图像然后处理”机制的传统成像系统无法满足这一前所未有的需求。不同的是,计算成像(CI)系统的设计是为了以编码方式获取高维数据,为移动视觉系统提供更多的信息。感谢AI,现在通过将深度学习算法纳入移动视觉平台以实现智能获取、处理和决策的闭路循环,从而导致下一次移动视觉革命,CI现在可以在实际系统中使用,从而在“先捕图像然后处理”的基础上开发先进的移动平台。基于“先捕图像,然后处理”机制的传统成像系统无法满足这一前所未有的需求。不同的是,计算成像(CI)系统的设计是为了以编码化的方式获取高维数据,为移动视觉系统提供更多的信息。感谢AI(通常使用AI来改进CI的性能,只有有限的工程才能深入连接到这些系统),在这项工作中,我们提出了一个框架,通过使用数字相机来深入整合移动视觉,然后用新的智能系统来进行计算机,我们最后通过互联网的高速将CI公司和新的飞行器的动力,然后用新的数字来调查。