Depth cameras are emerging as a cornerstone modality with diverse applications that directly or indirectly rely on measured depth, including personal devices, robotics, and self-driving vehicles. Although time-of-flight (ToF) methods have fueled these applications, the precision and robustness of ToF methods is limited by relying on photon time-tagging or modulation after photo-conversion. Successful optical modulation approaches have been restricted fiber-coupled modulation with large coupling losses or interferometric modulation with sub-cm range, and the precision gap between interferometric methods and ToF methods is more than three orders of magnitudes. In this work, we close this gap and propose a computational imaging method for all-optical free-space correlation before photo-conversion that achieves micron-scale depth resolution with robustness to surface reflectance and ambient light with conventional silicon intensity sensors. To this end, we solve two technical challenges: modulating at GHz rates and computational phase unwrapping. We propose an imaging approach with resonant polarization modulators and devise a novel optical dual-pass frequency-doubling which achieves high modulation contrast at more than 10GHz. At the same time, centimeter-wave modulation together with a small modulation bandwidth render existing phase unwrapping methods ineffective. We tackle this problem with a neural phase unwrapping method that exploits that adjacent wraps are often highly correlated. We validate the proposed method in simulation and experimentally, where it achieves micron-scale depth precision. We demonstrate precise depth sensing independently of surface texture and ambient light and compare against existing analog demodulation methods, which we outperform across all tested scenarios.
翻译:深度摄像头正在作为一种基石模式出现,其各种应用直接或间接地依赖于测量深度,包括个人装置、机器人和自驾驶飞行器。虽然飞行时间(to-F)方法为这些应用提供了动力,但托-F方法的精确性和稳健性因依赖光度时间拖动或光变换后调制而受到限制。成功的光调制方法已限制纤维混合调节,且其与大量混合损失或以子相控范围进行干涉调节,而且干涉测量方法和托-F方法之间的精确差距超过三个数量级。在这项工作中,我们缩小这一差距,并提议在光转换之前采用全光自由空间的计算成像方法,使显微深度分辨率与表面反射度和光度常规硅强度传感器进行调节。为此,我们解决了两个技术挑战:以 GHz 速度进行调节, 和计算阶段的透析方法之间的精确度差差超过三个数量级。我们建议采用不共振化的透析方法, 并设计一种新式的直观-直径直径直径直径直流的直径直径直径直径直径直径直变的直径直径直径直的直径直径直径直的计算方法。