Deep Semantic Bridging Network for Parallax-Robust Visible-Infrared Multimodal Object Detection in UAV Remote Sensing
IEEE Transactions on Geoscience and Remote Sensing · 2026 · 64 · 5405713-5405713
DOI: 10.1109/tgrs.2026.3697288 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Geoscience and Remote Sensing, 2026. Verfasst von Lulu Meng und 2 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 44 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Postdoctoral Fellowship Program (Grade B) of China Postdoctoral Science Foundation, China Postdoctoral Science Foundation.
Abstract (Originalsprache)
Visible-infrared (RGB-T) multimodal object detection on uncrewed aerial vehicles (UAVs) is challenged by physical parallax, modality conflicts, and information loss of small targets (sub-32 pixels). Existing fusion methods struggle with precise alignment in dynamic environments and suffer from representational competition, limiting detection accuracy. To address these issues, this article proposes a parallax-aware detection framework, PAO-YOLO, built on a deep semantic bridging architecture. It introduces a modality-invariant feature disentanglement (MIFD) module to decouple geometric structures from modality-specific noise within an orthogonal common subspace. These structural priors then guide an elastic deformation adaptive fusion (EDAF) module, which employs predicted offset fields and deformable convolutions for pixel-level alignment. Additionally, a high-resolution P2 detection layer preserves spatial gradients for enhanced small-target perception. Experiments on the DroneVehicle and DVTOD datasets show that PAO-YOLO achieves 82.2% and 89.2% mAP@0.5, respectively. The method effectively mitigates parallax artifacts and improves sensitivity to small targets, sustaining a robust inference speed of 85.6 frames per second (FPS) on a standard GPU. Code is available at: https://github.com/PAO-YOLO-Team/PAO-YOLO.git
Förderung
- National Natural Science Foundation of China
- Postdoctoral Fellowship Program (Grade B) of China Postdoctoral Science Foundation
- China Postdoctoral Science Foundation
- Key Laboratory of Embedded System and Service Computing of Ministry of Education of China
- Key Laboratory of System Control and Information Processing of Ministry of Education of China
Zitieren
APA
Meng, L., Ju, X., & Li, Z. (2026). Deep Semantic Bridging Network for Parallax-Robust Visible-Infrared Multimodal Object Detection in UAV Remote Sensing. IEEE Transactions on Geoscience and Remote Sensing, 64, 5405713-5405713. https://doi.org/10.1109/tgrs.2026.3697288
Vancouver
Meng L, Ju X, Li Z. Deep Semantic Bridging Network for Parallax-Robust Visible-Infrared Multimodal Object Detection in UAV Remote Sensing. IEEE Transactions on Geoscience and Remote Sensing. 2026;64:5405713-5405713. doi:10.1109/tgrs.2026.3697288
BibTeX
@article{Meng2026,
author = {Meng, Lulu and Ju, Xingxing and Li, Zhi},
title = {Deep Semantic Bridging Network for Parallax-Robust Visible-Infrared Multimodal Object Detection in UAV Remote Sensing},
journal = {IEEE Transactions on Geoscience and Remote Sensing},
year = {2026},
volume = {64},
pages = {5405713--5405713},
doi = {10.1109/tgrs.2026.3697288}
}
EUVIMED