EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

MEEAFusion: Multi-Scale Edge Enhancement and Joint Attention Mechanism Based Infrared and Visible Image Fusion

Yingjiang Xie iD, Zhennan Fei, Da Deng, Lingshuai Meng, Fu Niu, Jinggong Sun

Sensors · 09.09.2024 · 24 (17) · 5860

DOI: 10.3390/s24175860 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 09.09.2024. Verfasst von Yingjiang Xie und 5 weiteren Autor:innen. Beteiligte Einrichtung: Systems Engineering Institute, Academy of Military Sciences, PLA, Beijing 100166, China. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 57 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Infrared and visible image fusion can integrate rich edge details and salient infrared targets, resulting in high-quality images suitable for advanced tasks. However, most available algorithms struggle to fully extract detailed features and overlook the interaction of complementary features across different modal images during the feature fusion process. To address this gap, this study presents a novel fusion method based on multi-scale edge enhancement and a joint attention mechanism (MEEAFusion). Initially, convolution kernels of varying scales were utilized to obtain shallow features with multiple receptive fields unique to the source image. Subsequently, a multi-scale gradient residual block (MGRB) was developed to capture the high-level semantic information and low-level edge texture information of the image, enhancing the representation of fine-grained features. Then, the complementary feature between infrared and visible images was defined, and a cross-transfer attention fusion block (CAFB) was devised with joint spatial attention and channel attention to refine the critical supplemental information. This allowed the network to obtain fused features that were rich in both common and complementary information, thus realizing feature interaction and pre-fusion. Lastly, the features were reconstructed to obtain the fused image. Extensive experiments on three benchmark datasets demonstrated that the MEEAFusion proposed in this research has considerable strengths in terms of rich texture details, significant infrared targets, and distinct edge contours, and it achieves superior fusion performance.

Schlagwörter

Stichwörter der Autor:innen

attention mechanismedge enhancementimage fusioninfrared imagevisible image

Autor:innen und Institutionen

  • Systems Engineering Institute, Academy of Military Sciences, PLA, Beijing 100166, China.

ORCID-Profile: Yingjiang Xie

Zitieren

APA

Xie, Y., Fei, Z., Deng, D., Meng, L., Niu, F., & Sun, J. (2024). MEEAFusion: Multi-Scale Edge Enhancement and Joint Attention Mechanism Based Infrared and Visible Image Fusion. Sensors, 24(17), 5860. https://doi.org/10.3390/s24175860

Vancouver

Xie Y, Fei Z, Deng D, Meng L, Niu F, Sun J. MEEAFusion: Multi-Scale Edge Enhancement and Joint Attention Mechanism Based Infrared and Visible Image Fusion. Sensors. 2024;24(17):5860. doi:10.3390/s24175860

BibTeX
@article{Xie2024,
  author = {Xie, Yingjiang and Fei, Zhennan and Deng, Da and Meng, Lingshuai and Niu, Fu and Sun, Jinggong},
  title = {MEEAFusion: Multi-Scale Edge Enhancement and Joint Attention Mechanism Based Infrared and Visible Image Fusion},
  journal = {Sensors},
  year = {2024},
  volume = {24},
  number = {17},
  pages = {5860},
  doi = {10.3390/s24175860}
}
Kostenlos starten →