Infrared and Visible Image Fusion via Residual Interactive Transformer and Cross-Attention Fusion
Sensors · 10.07.2025 · 25 (14) · 4307
DOI: 10.3390/s25144307 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 10.07.2025. Verfasst von Liquan Zhao und 4 weiteren Autor:innen. Beteiligte Einrichtung: Key Laboratory of Modern Power System Simulation and Control & Renewable Energy Technology, Ministry of Education (Northeast Electric Power Universit…. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 34 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Natural Science Foundation of Heilongjiang Province.
Abstract (Originalsprache)
Infrared and visible image fusion combines infrared and visible images of the same scene to produce a more informative and comprehensive fused image. Existing deep learning-based fusion methods fail to establish dependencies between global and local information during feature extraction. This results in unclear scene texture details and low contrast of the infrared thermal targets in the fused image. This paper proposes an infrared and visible image fusion network to address this issue via the use of a residual interactive transformer and cross-attention fusion. The network first introduces a residual dense module to extract shallow features from the input infrared and visible images. Next, the residual interactive transformer extracts global and local features from the source images and establishes interactions between them. Two identical residual interactive transformers are used for further feature extraction. A cross-attention fusion module is also designed to fuse the infrared and visible feature maps extracted by the residual interactive transformer. Finally, an image reconstruction network generates the fused image. The proposed method is evaluated on the RoadScene, TNO, and M3FD datasets. The experimental results show that the fused images produced by the proposed method contain more visible texture details and infrared thermal information. Compared to nine other methods, the proposed approach achieves superior fusion performance.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Key Laboratory of Modern Power System Simulation and Control & Renewable Energy Technology, Ministry of Education (Northeast Electric Power University), Jilin 132012, China.
- College of Electrical and Information Engineering, Beihua University, Jilin 132013, China.
- School of Electronic and Information Engineering, Heilongjiang Institute of Technology, Harbin 150050, China.
- School of Electrical Engineering, Northeast Electric Power University, Jilin 132012, China.
ORCID-Profile: Liquan Zhao, Cong Xu
Förderung
- Natural Science Foundation of Heilongjiang Province
Zitieren
APA
Zhao, L., Ke, C., Jia, Y., Xu, C., & Teng, Z. (2025). Infrared and Visible Image Fusion via Residual Interactive Transformer and Cross-Attention Fusion. Sensors, 25(14), 4307. https://doi.org/10.3390/s25144307
Vancouver
Zhao L, Ke C, Jia Y, Xu C, Teng Z. Infrared and Visible Image Fusion via Residual Interactive Transformer and Cross-Attention Fusion. Sensors. 2025;25(14):4307. doi:10.3390/s25144307
BibTeX
@article{Zhao2025,
author = {Zhao, Liquan and Ke, Chen and Jia, Yanfei and Xu, Cong and Teng, Zhijun},
title = {Infrared and Visible Image Fusion via Residual Interactive Transformer and Cross-Attention Fusion},
journal = {Sensors},
year = {2025},
volume = {25},
number = {14},
pages = {4307},
doi = {10.3390/s25144307}
}
EUVIMED