Infrared and Visible Image Fusion via Attention-Based Adaptive Feature Fusion
Entropy · 23.02.2023 · 25 (3) · 407
DOI: 10.3390/e25030407 ↗Kurz gefasst
Fachartikel in der Zeitschrift Entropy, online erschienen am 23.02.2023. Verfasst von Lei Wang und 4 weiteren Autor:innen. Beteiligte Einrichtung: Hubei Key Laboratory of Optical Information and Pattern Recognition, Wuhan Institute of Technology, Wuhan 430205, China. Die Arbeit wurde bisher 19-mal zitiert (Crossref) und nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Infrared and visible image fusion methods based on feature decomposition are able to generate good fused images. However, most of them employ manually designed simple feature fusion strategies in the reconstruction stage, such as addition or concatenation fusion strategies. These strategies do not pay attention to the relative importance between different features and thus may suffer from issues such as low-contrast, blurring results or information loss. To address this problem, we designed an adaptive fusion network to synthesize decoupled common structural features and distinct modal features under an attention-based adaptive fusion (AAF) strategy. The AAF module adaptively computes different weights assigned to different features according to their relative importance. Moreover, the structural features from different sources are also synthesized under the AAF strategy before reconstruction, to provide a more entire structure information. More important features are thus paid more attention to automatically and advantageous information contained in these features manifests itself more reasonably in the final fused images. Experiments on several datasets demonstrated an obvious improvement of image fusion quality using our method.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Hubei Key Laboratory of Optical Information and Pattern Recognition, Wuhan Institute of Technology, Wuhan 430205, China.
- School of Art & Design, Wuhan Institute of Technology, Wuhan 430205, China.
ORCID-Profile: Lei Wang
Zitieren
APA
Wang, L., Hu, Z., Kong, Q., Qi, Q., & Liao, Q. (2023). Infrared and Visible Image Fusion via Attention-Based Adaptive Feature Fusion. Entropy, 25(3), 407. https://doi.org/10.3390/e25030407
Vancouver
Wang L, Hu Z, Kong Q, Qi Q, Liao Q. Infrared and Visible Image Fusion via Attention-Based Adaptive Feature Fusion. Entropy. 2023;25(3):407. doi:10.3390/e25030407
BibTeX
@article{Wang2023,
author = {Wang, Lei and Hu, Ziming and Kong, Quan and Qi, Qian and Liao, Qing},
title = {Infrared and Visible Image Fusion via Attention-Based Adaptive Feature Fusion},
journal = {Entropy},
year = {2023},
volume = {25},
number = {3},
pages = {407},
doi = {10.3390/e25030407}
}
EUVIMED