EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Leveraging CNNs for Panoramic Image Matching Based on Improved Cube Projection Model

Tian Gao, Chaozhen Lan, Longhao Wang, Wenjun Huang, Fushan Yao, Zijun Wei

Remote Sensing · 05.07.2023 · 15 (13) · 3411

DOI: 10.3390/rs15133411 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 05.07.2023. Verfasst von Tian Gao und 5 weiteren Autor:innen. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 43 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Three-dimensional (3D) scene reconstruction plays an important role in digital cities, virtual reality, and simultaneous localization and mapping (SLAM). In contrast to perspective images, a single panoramic image can contain the complete scene information because of the wide field of view. The extraction and matching of image feature points is a critical and difficult part of 3D scene reconstruction using panoramic images. We attempted to solve this problem using convolutional neural networks (CNNs). Compared with traditional feature extraction and matching algorithms, the SuperPoint (SP) and SuperGlue (SG) algorithms have advantages for handling images with distortions. However, the rich content of panoramic images leads to a significant disadvantage of these algorithms with regard to time loss. To address this problem, we introduce the Improved Cube Projection Model: First, the panoramic image is projected into split-frame perspective images with significant overlap in six directions. Second, the SP and SG algorithms are used to process the six split-frame images in parallel for feature extraction and matching. Finally, matching points are mapped back to the panoramic image through coordinate inverse mapping. Experimental results in multiple environments indicated that the algorithm can not only guarantee the number of feature points extracted and the accuracy of feature point extraction but can also significantly reduce the computation time compared to other commonly used algorithms.

Zitieren

APA

Gao, T., Lan, C., Wang, L., Huang, W., Yao, F., & Wei, Z. (2023). Leveraging CNNs for Panoramic Image Matching Based on Improved Cube Projection Model. Remote Sensing, 15(13), 3411. https://doi.org/10.3390/rs15133411

Vancouver

Gao T, Lan C, Wang L, Huang W, Yao F, Wei Z. Leveraging CNNs for Panoramic Image Matching Based on Improved Cube Projection Model. Remote Sensing. 2023;15(13):3411. doi:10.3390/rs15133411

BibTeX
@article{Gao2023,
  author = {Gao, Tian and Lan, Chaozhen and Wang, Longhao and Huang, Wenjun and Yao, Fushan and Wei, Zijun},
  title = {Leveraging CNNs for Panoramic Image Matching Based on Improved Cube Projection Model},
  journal = {Remote Sensing},
  year = {2023},
  volume = {15},
  number = {13},
  pages = {3411},
  doi = {10.3390/rs15133411}
}
Kostenlos starten →