3D reconstruction plays an increasingly important role in modern photogrammetric systems. Conventional satellite or aerial-based remote sensing (RS) platforms can provide the necessary data sources for the 3D reconstruction of large-scale landforms and cities. Even with low-altitude UAVs (Unmanned Aerial Vehicles), 3D reconstruction in complicated situations, such as urban canyons and indoor scenes, is challenging due to frequent tracking failures between camera frames and high data collection costs. Recently, spherical images have been extensively used due to the capability of recording surrounding environments from one camera exposure. In contrast to perspective images with limited FOV (Field of View), spherical images can cover the whole scene with full horizontal and vertical FOV and facilitate camera tracking and data acquisition in these complex scenes. With the rapid evolution and extensive use of professional and consumer-grade spherical cameras, spherical images show great potential for the 3D modeling of urban and indoor scenes. Classical 3D reconstruction pipelines, however, cannot be directly used for spherical images. Besides, there exist few software packages that are designed for the 3D reconstruction of spherical images. As a result, this research provides a thorough survey of the state-of-the-art for 3D reconstruction of spherical images in terms of data acquisition, feature detection and matching, image orientation, and dense matching as well as presenting promising applications and discussing potential prospects. We anticipate that this study offers insightful clues to direct future research.
翻译:3D重建在现代摄影测量系统中发挥着越来越重要的作用。常规卫星或空中遥感平台可以为大规模地面和城市的3D重建提供必要的数据源。即使使用低空无人驾驶飞行器,在城市峡谷和室内场景等复杂情况下的3D重建也具有挑战性,因为经常追踪摄像框架和高数据收集成本之间的失败。最近,由于能够从一次摄像接触中记录周围环境,球形图像被广泛使用。与有限的视野图像相比,球形图像可以全水平和垂直视野覆盖整个场景,便于在这些复杂场景中进行照相跟踪和数据采集。随着专业和消费级球形照相机的迅速演化和广泛使用,球形图像显示了城市和室内场景3D建模的巨大潜力。经典的3D重建管道无法直接用于球形图像。此外,我们设计了很少软件包,用于3D的视野图像(视野实地)的重建,而未来深度图像的深度勘测为未来前景勘测提供了精确图像的深度勘测,从而提供了一种状况研究,从而提供了一种对未来图像进行深度勘测的模型勘测的模型勘测。