Multispectral Target Detection Based on Deep Feature Fusion of Visible and Infrared Modalities
Applied Sciences · 23.05.2025 · 15 (11) · 5857
DOI: 10.3390/app15115857 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 23.05.2025. Verfasst von Yongsheng Zhao und 3 weiteren Autor:innen. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 53 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Liaoning Provincial Department of Science and Technology’s pilot project.
Abstract (Originalsprache)
Multispectral detection leverages visible and infrared imaging to improve detection performance in complex environments. However, conventional convolution-based fusion methods predominantly rely on local feature interactions, limiting their capacity to fully exploit cross-modal information and making them more susceptible to interference from complex backgrounds. To overcome these challenges, the YOLO-MEDet multispectral target detection model is proposed. Firstly, the YOLOv5 architecture is redesigned into a two-stream backbone network, incorporating a midway fusion strategy to integrate multimodal features from the C3 to C5 layers, thereby enhancing detection accuracy and robustness. Secondly, the Attention-Enhanced Feature Fusion Framework (AEFF) is introduced to optimize both cross-modal and intra-modal feature representations by employing an attention mechanism, effectively boosting model performance. Finally, the C3-PSA (C3 Pyramid Compressed Attention) module is integrated to reinforce multiscale spatial feature extraction and refine feature representation, ultimately improving detection accuracy while reducing false alarms and missed detections in complex scenarios. Extensive experiments on the FLIR, KAIST, and M3FD datasets, along with additional validation using SimuNPS simulations, confirm the superiority of YOLO-MEDet. The results indicate that the proposed model outperforms existing approaches across multiple evaluation metrics, providing an innovative solution for multispectral target detection.
Förderung
- Liaoning Provincial Department of Science and Technology’s pilot project
Zitieren
APA
Zhao, Y., Gao, Y., Yang, X., & Yang, L. (2025). Multispectral Target Detection Based on Deep Feature Fusion of Visible and Infrared Modalities. Applied Sciences, 15(11), 5857. https://doi.org/10.3390/app15115857
Vancouver
Zhao Y, Gao Y, Yang X, Yang L. Multispectral Target Detection Based on Deep Feature Fusion of Visible and Infrared Modalities. Applied Sciences. 2025;15(11):5857. doi:10.3390/app15115857
BibTeX
@article{Zhao2025,
author = {Zhao, Yongsheng and Gao, Yuxing and Yang, Xu and Yang, Luyang},
title = {Multispectral Target Detection Based on Deep Feature Fusion of Visible and Infrared Modalities},
journal = {Applied Sciences},
year = {2025},
volume = {15},
number = {11},
pages = {5857},
doi = {10.3390/app15115857}
}
EUVIMED