TY - JOUR
T1 - 3D reconstruction of spherical images
T2 - a review of techniques, applications, and prospects
AU - Jiang, San
AU - You, Kan
AU - Li, Yaxin
AU - Weng, Duojie
AU - Chen, Wu
N1 - Publisher Copyright:
© 2024 Wuhan University. Published by Informa UK Limited, trading as Taylor & Francis Group.
PY - 2024
Y1 - 2024
N2 - 3D reconstruction plays an increasingly important role in modern photogrammetric systems. Conventional satellite or aerial-based remote sensing (RS) platforms can provide the necessary data sources for the 3D reconstruction of large-scale landforms and cities. Even with low-altitude Unmanned Aerial Vehicles (UAVs), 3D reconstruction in complicated situations, such as urban canyons and indoor scenes, is challenging due to frequent tracking failures between camera frames and high data collection costs. Recently, spherical images have been extensively used due to the capability of recording surrounding environments from one image. In contrast to perspective images with limited Field of View (FOV), spherical images can cover the whole scene with full horizontal and vertical FOV and facilitate camera tracking and data acquisition in these complex scenes. With the rapid evolution and extensive use of professional and consumer-grade spherical cameras, spherical images show great potential for the 3D modeling of urban and indoor scenes. Classical 3D reconstruction pipelines, however, cannot be directly used for spherical images. Besides, there exist few software packages that are designed for the 3D reconstruction from spherical images. As a result, this research provides a thorough survey of the state-of-the-art for 3D reconstruction from spherical images in terms of data acquisition, feature detection and matching, image orientation, and dense matching as well as presenting promising applications and discussing potential prospects. We anticipate that this study offers insightful clues to direct future research.
AB - 3D reconstruction plays an increasingly important role in modern photogrammetric systems. Conventional satellite or aerial-based remote sensing (RS) platforms can provide the necessary data sources for the 3D reconstruction of large-scale landforms and cities. Even with low-altitude Unmanned Aerial Vehicles (UAVs), 3D reconstruction in complicated situations, such as urban canyons and indoor scenes, is challenging due to frequent tracking failures between camera frames and high data collection costs. Recently, spherical images have been extensively used due to the capability of recording surrounding environments from one image. In contrast to perspective images with limited Field of View (FOV), spherical images can cover the whole scene with full horizontal and vertical FOV and facilitate camera tracking and data acquisition in these complex scenes. With the rapid evolution and extensive use of professional and consumer-grade spherical cameras, spherical images show great potential for the 3D modeling of urban and indoor scenes. Classical 3D reconstruction pipelines, however, cannot be directly used for spherical images. Besides, there exist few software packages that are designed for the 3D reconstruction from spherical images. As a result, this research provides a thorough survey of the state-of-the-art for 3D reconstruction from spherical images in terms of data acquisition, feature detection and matching, image orientation, and dense matching as well as presenting promising applications and discussing potential prospects. We anticipate that this study offers insightful clues to direct future research.
KW - 3D reconstruction
KW - dense matching
KW - equirectangular projection
KW - image matching
KW - simultaneous localization and mapping
KW - Spherical image
KW - structure from motion
UR - http://www.scopus.com/inward/record.url?scp=85187186334&partnerID=8YFLogxK
U2 - 10.1080/10095020.2024.2313328
DO - 10.1080/10095020.2024.2313328
M3 - Review article
AN - SCOPUS:85187186334
SN - 1009-5020
JO - Geo-Spatial Information Science
JF - Geo-Spatial Information Science
ER -