EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

ESFuse: Weak Edge Structure Perception Network for Infrared and Visible Image Fusion

Wuyang Liu, Haishu Tan, Xiaoqi Cheng, Xiaosong Li

Electronics · 18.10.2024 · 13 (20) · 4115

DOI: 10.3390/electronics13204115 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Electronics, online erschienen am 18.10.2024. Verfasst von Wuyang Liu und 3 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 62 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Basic and Applied Basic Research of Guangdong Province, Natural Science Foundation of Guangdong Province, National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Infrared and visible image fusion (IVIF) fully integrates the complementary features of different modal images, and the fused image provides a more comprehensive and objective interpretation of the scene compared to each source image, thus attracting extensive attention in the field of computer vision in recent years. However, current fusion methods usually center their attention on the extraction of prominent features, falling short of adequately safeguarding subtle and diminutive structures. To address this problem, we propose an end-to-end unsupervised IVIF method (ESFuse), which effectively enhances fine edges and small structures. In particular, we introduce a two-branch head interpreter to extract features from source images of different modalities. Subsequently, these features are fed into the edge refinement module with the detail injection module (DIM) to obtain the edge detection results of the source image, improving the network’s ability to capture and retain complex details as well as global information. Finally, we implemented a multiscale feature reconstruction module to obtain the final fusion results by combining the output of the DIM with the output of the head interpreter. Extensive IVIF fusion experiments on existing publicly available datasets show that the proposed ESFuse outperforms the state-of-the-art(SOTA) methods in both subjective vision and objective evaluation, and our fusion results perform well in semantic segmentation, target detection, pose estimation and depth estimation tasks. The source code has been availabled.

Förderung

  • Basic and Applied Basic Research of Guangdong Province
  • Natural Science Foundation of Guangdong Province
  • National Natural Science Foundation of China
  • Guangdong Higher Education Innovation and Strengthening of Universities Project
  • Research Fund of Guangdong-HongKong-Macao Joint Laboratory for Intelligent Micro-Nano Optoelectronic Technology

Zitieren

APA

Liu, W., Tan, H., Cheng, X., & Li, X. (2024). ESFuse: Weak Edge Structure Perception Network for Infrared and Visible Image Fusion. Electronics, 13(20), 4115. https://doi.org/10.3390/electronics13204115

Vancouver

Liu W, Tan H, Cheng X, Li X. ESFuse: Weak Edge Structure Perception Network for Infrared and Visible Image Fusion. Electronics. 2024;13(20):4115. doi:10.3390/electronics13204115

BibTeX
@article{Liu2024,
  author = {Liu, Wuyang and Tan, Haishu and Cheng, Xiaoqi and Li, Xiaosong},
  title = {ESFuse: Weak Edge Structure Perception Network for Infrared and Visible Image Fusion},
  journal = {Electronics},
  year = {2024},
  volume = {13},
  number = {20},
  pages = {4115},
  doi = {10.3390/electronics13204115}
}
Kostenlos starten →