Recently, self-supervised learning of depth and ego-motion from thermal images shows strong robustness and reliability under challenging scenarios. However, the inherent thermal image properties such as weak contrast, blurry edges, and noise hinder to generate effective self-supervision from thermal images. Therefore, most research relies on additional self-supervision sources such as well-lit RGB images, generative models, and Lidar information. In this paper, we conduct an in-depth analysis of thermal image characteristics that degenerates self-supervision from thermal images. Based on the analysis, we propose an effective thermal image mapping method that significantly increases image information, such as overall structure, contrast, and details, while preserving temporal consistency. The proposed method shows outperformed depth and pose results than previous state-of-the-art networks without leveraging additional RGB guidance.
翻译:最近,在自我监督下,从热图像中了解深度和自我感动,这在具有挑战性的情景下显示出很强的强健性和可靠性。然而,内在的热图像特性,如微弱对比度、模糊边缘和噪音等,妨碍了从热图像中产生有效的自我监督。因此,大多数研究依赖于更多的自我监督来源,如光亮RGB图像、基因模型和利达尔信息。在本文中,我们对热图像特征进行深入分析,使热图像自我监督的图像退化。根据分析,我们提出了有效的热图像绘图方法,在保持时间一致性的同时,大幅增加图像信息,如总体结构、对比和细节。拟议方法显示的深度超过以往最先进的网络,并产生结果,而没有利用新的RGB指导。