With the development of computational intelligence algorithms, unsupervised monocular depth and pose estimation framework, which is driven by warped photometric consistency, has shown great performance in the daytime scenario. While in some challenging environments, like night and rainy night, the essential photometric consistency hypothesis is untenable because of the complex lighting and reflection, so that the above unsupervised framework cannot be directly applied to these complex scenarios. In this paper, we investigate the problem of unsupervised monocular depth estimation in highly complex scenarios and address this challenging problem by adopting an image transfer-based domain adaptation framework. We adapt the depth model trained on day-time scenarios to be applicable to night-time scenarios, and constraints on both feature space and output space promote the framework to learn the key features for depth decoding. Meanwhile, we further tackle the effects of unstable image transfer quality on domain adaptation, and an image adaptation approach is proposed to evaluate the quality of transferred images and re-weight the corresponding losses, so as to improve the performance of the adapted depth model. Extensive experiments show the effectiveness of the proposed unsupervised framework in estimating the dense depth map from highly complex images.
翻译:随着计算智能算法的开发,不受监督的单眼深度和估计框架的开发,由扭曲的光度一致性驱动,在日间情景中表现出了巨大的性能。虽然在某些富有挑战性的环境中,如夜间和雨季,基本的光度一致性假设是站不住脚的,因为照明和反射十分复杂,因此上述不受监督的框架不能直接适用于这些复杂的情景。在本文件中,我们调查了在高度复杂的情景中未经监督的单眼深度估算问题,并通过采用基于图像传输的域适应框架解决了这一具有挑战性的问题。我们调整了日间情景培训的深度模型,使之适用于夜间情景,对地貌空间和产出空间的限制促进了学习深度解码关键特征的框架。与此同时,我们进一步处理图像传输质量不稳定对领域适应的影响,并提议采用图像调整方法来评估所传输图像的质量和相应损失的重量,以便改进经调整的深度模型的性能。广泛的实验显示拟议的未经监督的框架在从高度复杂的图像中估算密度深度地图方面的有效性。