IV-PAFNet: Infrared-visible cross-modal alignment and fusion network for nighttime UAV object detection
PLOS One · 2026
DOI: 10.1371/journal.pone.0361401 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS One, 2026. Verfasst von Cheng Yuan und 4 weiteren Autor:innen. Beteiligte Einrichtung: School of Computer Science and Technology, Shandong University of Technology, Zibo, Shandong, China. Hauptthemen laut MEDLINE: Unmanned Aerial Devices, Image Processing, Computer-Assisted. Die Arbeit nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Natural Science Foundation of Shandong Province.
Abstract (Originalsprache)
Nighttime unmanned aerial vehicle object detection is challenged by degraded visible-light textures, cluttered infrared thermal responses, and local spatial discrepancies between infrared and visible images. To address these issues, we propose IV-PAFNet, an infrared-visible purification, alignment, and fusion network designed for object detection in nighttime and low-visibility conditions. IV-PAFNet consists of two primary components. The infrared signal purification and spatial alignment module applies learnable high-pass filtering and gated residual fusion to refine infrared responses, followed by visible-guided offset prediction and differentiable resampling to alleviate local cross-modal spatial discrepancies. The multi-scale fusion attention enhancement module performs channel-wise modality recalibration and spatial reliability weighting at multiple feature-pyramid levels, allowing the network to adapt the contribution of each modality to local imaging conditions. In the training-based DroneVehicle and generalization-based Camera-vehicle1 datasets, IV-PAFNet achieves 62.81% mAP@0.5:0.95 and 51.4% mAP@0.5:0.95, respectively. Additional controlled experiments investigate the distinct roles of infrared purification, visible-guided alignment, channel recalibration, and spatial reliability modeling, while statistical and computational analyses characterize run-to-run variation and inference cost. The code is available at https://github.com/iv-pafnet/IV-PAFNet .
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- School of Computer Science and Technology, Shandong University of Technology, Zibo, Shandong, China.
ORCID-Profile: Bin Zhou
Förderung
- Natural Science Foundation of Shandong Province
Zitieren
APA
Yuan, C., Shang, S., Zhang, J., Zhang, Y., & Zhou, B. (2026). IV-PAFNet: Infrared-visible cross-modal alignment and fusion network for nighttime UAV object detection. PLOS One. https://doi.org/10.1371/journal.pone.0361401
Vancouver
Yuan C, Shang S, Zhang J, Zhang Y, Zhou B. IV-PAFNet: Infrared-visible cross-modal alignment and fusion network for nighttime UAV object detection. PLOS One. 2026. doi:10.1371/journal.pone.0361401
BibTeX
@article{Yuan2026,
author = {Yuan, Cheng and Shang, Shichang and Zhang, Jinghao and Zhang, Yang and Zhou, Bin},
title = {IV-PAFNet: Infrared-visible cross-modal alignment and fusion network for nighttime UAV object detection},
journal = {PLOS One},
year = {2026},
doi = {10.1371/journal.pone.0361401}
}
EUVIMED