EUVIMEDEUVIMED entdecken
Crossref

Deep Semantic Bridging Network for Parallax-Robust Visible-Infrared Multimodal Object Detection in UAV Remote Sensing

Lulu Meng, Xingxing Ju, Zhi Li

IEEE Transactions on Geoscience and Remote Sensing · 2026 · 64 · 5405713-5405713

DOI: 10.1109/tgrs.2026.3697288 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Geoscience and Remote Sensing, 2026. Verfasst von Lulu Meng und 2 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 44 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Postdoctoral Fellowship Program (Grade B) of China Postdoctoral Science Foundation, China Postdoctoral Science Foundation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Visible-infrared (RGB-T) multimodal object detection on uncrewed aerial vehicles (UAVs) is challenged by physical parallax, modality conflicts, and information loss of small targets (sub-32 pixels). Existing fusion methods struggle with precise alignment in dynamic environments and suffer from representational competition, limiting detection accuracy. To address these issues, this article proposes a parallax-aware detection framework, PAO-YOLO, built on a deep semantic bridging architecture. It introduces a modality-invariant feature disentanglement (MIFD) module to decouple geometric structures from modality-specific noise within an orthogonal common subspace. These structural priors then guide an elastic deformation adaptive fusion (EDAF) module, which employs predicted offset fields and deformable convolutions for pixel-level alignment. Additionally, a high-resolution P2 detection layer preserves spatial gradients for enhanced small-target perception. Experiments on the DroneVehicle and DVTOD datasets show that PAO-YOLO achieves 82.2% and 89.2% mAP@0.5, respectively. The method effectively mitigates parallax artifacts and improves sensitivity to small targets, sustaining a robust inference speed of 85.6 frames per second (FPS) on a standard GPU. Code is available at: https://github.com/PAO-YOLO-Team/PAO-YOLO.git

Förderung

  • National Natural Science Foundation of China
  • Postdoctoral Fellowship Program (Grade B) of China Postdoctoral Science Foundation
  • China Postdoctoral Science Foundation
  • Key Laboratory of Embedded System and Service Computing of Ministry of Education of China
  • Key Laboratory of System Control and Information Processing of Ministry of Education of China

Zitieren

APA

Meng, L., Ju, X., & Li, Z. (2026). Deep Semantic Bridging Network for Parallax-Robust Visible-Infrared Multimodal Object Detection in UAV Remote Sensing. IEEE Transactions on Geoscience and Remote Sensing, 64, 5405713-5405713. https://doi.org/10.1109/tgrs.2026.3697288

Vancouver

Meng L, Ju X, Li Z. Deep Semantic Bridging Network for Parallax-Robust Visible-Infrared Multimodal Object Detection in UAV Remote Sensing. IEEE Transactions on Geoscience and Remote Sensing. 2026;64:5405713-5405713. doi:10.1109/tgrs.2026.3697288

BibTeX
@article{Meng2026,
  author = {Meng, Lulu and Ju, Xingxing and Li, Zhi},
  title = {Deep Semantic Bridging Network for Parallax-Robust Visible-Infrared Multimodal Object Detection in UAV Remote Sensing},
  journal = {IEEE Transactions on Geoscience and Remote Sensing},
  year = {2026},
  volume = {64},
  pages = {5405713--5405713},
  doi = {10.1109/tgrs.2026.3697288}
}
Kostenlos starten →