Today, Multi-View Stereo techniques are able to reconstruct robust and detailed 3D models, especially when starting from high-resolution images. However, there are cases in which the resolution of input images is relatively low, for instance, when dealing with old photos, or when hardware constrains the amount of data that can be acquired. In this paper, we investigate if, how, and how much increasing the resolution of such input images through Super-Resolution techniques reflects in quality improvements of the reconstructed 3D models, despite the artifacts that sometimes this may generate. We show that applying a Super-Resolution step before recovering the depth maps in most cases leads to a better 3D model both in the case of PatchMatch-based and deep-learning-based algorithms. The use of Super-Resolution improves especially the completeness of reconstructed models and turns out to be particularly effective in the case of textured scenes.
翻译:今天,多视立体技术能够重建稳健和详细的立体模型,特别是从高分辨率图像开始。然而,有些情况下,输入图像的分辨率相对较低,例如处理旧照片时,或者硬件限制可获取数据的数量。在本文中,我们调查通过超分辨率技术提高这种输入图像的分辨率是否、如何以及在多大程度上反映了重建后的立体模型的质量改进,尽管有时这可能会产生人工制品。我们表明,在恢复深度地图之前,在多数情况下,在恢复深度地图之前,采用超级分辨率步骤可以导致更好的3D模型,在PatchMatch基于和深层学习的算法中,超级分辨率的使用尤其提高了重建后的模型的完整性,在发胶场景中则特别有效。