EUVIMEDEUVIMED entdecken
Crossref

CEFusion: An Infrared and Visible Image Fusion Network Based on Cross-Modal Multi-Granularity Information Interaction and Edge Guidance

Bin Yang, Yuxuan Hu, Xiaowen Liu, Jing Li

IEEE Transactions on Intelligent Transportation Systems · 2024-11 · 25 (11) · 17794-17809

DOI: 10.1109/tits.2024.3426539 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Intelligent Transportation Systems, 2024-11. Verfasst von Bin Yang und 3 weiteren Autor:innen. Die Arbeit wurde bisher 48-mal zitiert (Crossref) und nennt 62 Literaturangaben. Gefördert von: Natural Science Foundation of Hainan Province, Key Research and Development Program of Hunan Province, China, National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Infrared and visible image fusion (IVF) aims to generate a fused image with abundant texture details and salient thermal radiation targets, which can not only preserve the necessary scene information for traffic vision tasks, but also highlight the imperceptible targets that are crucial in intelligent transportation system (ITS). However, the existing image fusion methods often lack the information interactions between cross-modal features and among cross-granularity features, and they usually ignore the importance of edge information to the image, which affects the quality of the fused image. To this end, this study proposes an IVF network based on cross-modal multi-granularity information interaction and edge guidance, termed as CEFusion. On the one hand, a triple-branch scene fidelity module is designed to fuse the different modal features extracted by the encoder. This module can adequately mine difference information and infrared salient information of the cross-modal features through cross-modal information interaction. On the other hand, a progressive cross-granularity interaction feature enhancement module is employed to achieve the information interaction among cross-granularity features, which can further enrich the texture and structure information in the fused features. In addition, a novel edge loss function is proposed to guide the network to retain the edge information from source images. Extensive comparative and generalization experiments demonstrate that our CEFusion superior to the state-of-the-art methods in preserving texture details and thermal radiation targets. More importantly, the performance of our method in the high-level vision task suggests that it can provide reliable assistance for the ITS applications.

Förderung

  • Natural Science Foundation of Hainan Province
  • Key Research and Development Program of Hunan Province, China
  • National Natural Science Foundation of China
  • Changsha Science and Technology Project
  • National Key Research and Development Program of China

Zitieren

APA

Yang, B., Hu, Y., Liu, X., & Li, J. (2024). CEFusion: An Infrared and Visible Image Fusion Network Based on Cross-Modal Multi-Granularity Information Interaction and Edge Guidance. IEEE Transactions on Intelligent Transportation Systems, 25(11), 17794-17809. https://doi.org/10.1109/tits.2024.3426539

Vancouver

Yang B, Hu Y, Liu X, Li J. CEFusion: An Infrared and Visible Image Fusion Network Based on Cross-Modal Multi-Granularity Information Interaction and Edge Guidance. IEEE Transactions on Intelligent Transportation Systems. 2024;25(11):17794-17809. doi:10.1109/tits.2024.3426539

BibTeX
@article{Yang2024,
  author = {Yang, Bin and Hu, Yuxuan and Liu, Xiaowen and Li, Jing},
  title = {CEFusion: An Infrared and Visible Image Fusion Network Based on Cross-Modal Multi-Granularity Information Interaction and Edge Guidance},
  journal = {IEEE Transactions on Intelligent Transportation Systems},
  year = {2024},
  volume = {25},
  number = {11},
  pages = {17794--17809},
  doi = {10.1109/tits.2024.3426539}
}
Kostenlos starten →