Semantic-Guided Matching of Heterogeneous UAV Imagery and Mobile LiDAR Data Using Deep Learning and Graph Neural Networks
Drones · 08.03.2026 · 10 (3) · 185
DOI: 10.3390/drones10030185 ↗Kurz gefasst
Fachartikel in der Zeitschrift Drones, online erschienen am 08.03.2026. Verfasst von Tee-Ann Teo und 2 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 26 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Science and Technology Council, Taiwan, Ministry of Interior, Taiwan.
Abstract (Originalsprache)
The integration of heterogeneous geospatial data, specifically low-cost unmanned aerial vehicle (UAV) imagery and mobile light detection and ranging (LiDAR) system point clouds, presents a significant challenge due to the significant radiometric and structural discrepancies between the two modalities. This study proposes a novel air-to-ground semantic feature matching framework to achieve precise geometric registration between these data sources by effectively incorporating semantic-constraint deep learning-based matching. The methodology transformed the cross-sensor alignment challenge into a robust two-dimensional image matching problem. This was achieved by first using YOLOv11 for semantic segmentation of common road markings in both the UAV orthoimage and the converted LiDAR intensity image to generate highly consistent feature references. Subsequently, the SuperPoint detector and a graph neural network matcher, SuperGlue, were applied to these semantic images to establish reliable geomatics information correspondence points. Experimental results confirmed that this semantic-guided strategy consistently outperformed traditional feature-based matching (i.e., scale-invariant feature transform + fast library for approximate nearest neighbors), particularly by converting the noisy LiDAR intensity image into a stabilized semantic representation. The explicit application of semantic constraints further proved effective in eliminating false matches between geometrically similar but semantically distinct objects. The final object-specific analysis demonstrated that features with clear, complex geometric structures (e.g., pedestrian crossings and directional arrows) provide the most robust matching control. In summary, the proposed framework successfully leverages semantic context to overcome cross-sensor heterogeneity, offering an automated and precise solution for the geometric alignment of mobile LiDAR data.
Förderung
- National Science and Technology Council, Taiwan
- Ministry of Interior, Taiwan
Zitieren
APA
Teo, T., Yu, H., & Chen, P. (2026). Semantic-Guided Matching of Heterogeneous UAV Imagery and Mobile LiDAR Data Using Deep Learning and Graph Neural Networks. Drones, 10(3), 185. https://doi.org/10.3390/drones10030185
Vancouver
Teo T, Yu H, Chen P. Semantic-Guided Matching of Heterogeneous UAV Imagery and Mobile LiDAR Data Using Deep Learning and Graph Neural Networks. Drones. 2026;10(3):185. doi:10.3390/drones10030185
BibTeX
@article{Teo2026,
author = {Teo, Tee-Ann and Yu, Hao and Chen, Pei-Cheng},
title = {Semantic-Guided Matching of Heterogeneous UAV Imagery and Mobile LiDAR Data Using Deep Learning and Graph Neural Networks},
journal = {Drones},
year = {2026},
volume = {10},
number = {3},
pages = {185},
doi = {10.3390/drones10030185}
}
EUVIMED