EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Infrared and Visible Image Fusion via Attention-Based Adaptive Feature Fusion

Lei Wang iD, Ziming Hu, Quan Kong, Qian Qi, Qing Liao

Entropy · 23.02.2023 · 25 (3) · 407

DOI: 10.3390/e25030407 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Entropy, online erschienen am 23.02.2023. Verfasst von Lei Wang und 4 weiteren Autor:innen. Beteiligte Einrichtung: Hubei Key Laboratory of Optical Information and Pattern Recognition, Wuhan Institute of Technology, Wuhan 430205, China. Die Arbeit wurde bisher 19-mal zitiert (Crossref) und nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Infrared and visible image fusion methods based on feature decomposition are able to generate good fused images. However, most of them employ manually designed simple feature fusion strategies in the reconstruction stage, such as addition or concatenation fusion strategies. These strategies do not pay attention to the relative importance between different features and thus may suffer from issues such as low-contrast, blurring results or information loss. To address this problem, we designed an adaptive fusion network to synthesize decoupled common structural features and distinct modal features under an attention-based adaptive fusion (AAF) strategy. The AAF module adaptively computes different weights assigned to different features according to their relative importance. Moreover, the structural features from different sources are also synthesized under the AAF strategy before reconstruction, to provide a more entire structure information. More important features are thus paid more attention to automatically and advantageous information contained in these features manifests itself more reasonably in the final fused images. Experiments on several datasets demonstrated an obvious improvement of image fusion quality using our method.

Schlagwörter

Stichwörter der Autor:innen

adaptive fusion strategyattention mechanismimage fusion

Autor:innen und Institutionen

  • Hubei Key Laboratory of Optical Information and Pattern Recognition, Wuhan Institute of Technology, Wuhan 430205, China.
  • School of Art & Design, Wuhan Institute of Technology, Wuhan 430205, China.

ORCID-Profile: Lei Wang

Zitieren

APA

Wang, L., Hu, Z., Kong, Q., Qi, Q., & Liao, Q. (2023). Infrared and Visible Image Fusion via Attention-Based Adaptive Feature Fusion. Entropy, 25(3), 407. https://doi.org/10.3390/e25030407

Vancouver

Wang L, Hu Z, Kong Q, Qi Q, Liao Q. Infrared and Visible Image Fusion via Attention-Based Adaptive Feature Fusion. Entropy. 2023;25(3):407. doi:10.3390/e25030407

BibTeX
@article{Wang2023,
  author = {Wang, Lei and Hu, Ziming and Kong, Quan and Qi, Qian and Liao, Qing},
  title = {Infrared and Visible Image Fusion via Attention-Based Adaptive Feature Fusion},
  journal = {Entropy},
  year = {2023},
  volume = {25},
  number = {3},
  pages = {407},
  doi = {10.3390/e25030407}
}
Kostenlos starten →