EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

HDCCT: Hybrid Densely Connected CNN and Transformer for Infrared and Visible Image Fusion

Xue Li, Hui He, Jin Shi

Electronics · 31.08.2024 · 13 (17) · 3470

DOI: 10.3390/electronics13173470 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Electronics, online erschienen am 31.08.2024. Verfasst von Xue Li und 2 weiteren Autor:innen. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 54 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multi-modal image fusion is a methodology that combines image features from multiple types of sensors, effectively improving the quality and content of fused images. However, most existing deep learning fusion methods need to integrate global or local features, restricting the representation of feature information. To address this issue, a hybrid densely connected CNN and transformer (HDCCT) fusion framework is proposed. In the proposed HDCCT framework, the network of the CNN-based blocks obtain the local structure of the input data, and the transformer-based blocks obtain the global structure of the original data, significantly improving the feature representation. In the fused image, the proposed encoder–decoder architecture is designed for both the CNN and transformer blocks to reduce feature loss while preserving the characterization of all-level features. In addition, the cross-coupled framework facilitates the flow of feature structures, retains the uniqueness of information, and makes the transform model long-range dependencies based on the local features already extracted by the CNN. Meanwhile, to retain the information in the source images, the hybrid structural similarity (SSIM) and mean square error (MSE) loss functions are introduced. The qualitative and quantitative comparisons of grayscale images with infrared and visible image fusion indicate that the suggested method outperforms related works.

Zitieren

APA

Li, X., He, H., & Shi, J. (2024). HDCCT: Hybrid Densely Connected CNN and Transformer for Infrared and Visible Image Fusion. Electronics, 13(17), 3470. https://doi.org/10.3390/electronics13173470

Vancouver

Li X, He H, Shi J. HDCCT: Hybrid Densely Connected CNN and Transformer for Infrared and Visible Image Fusion. Electronics. 2024;13(17):3470. doi:10.3390/electronics13173470

BibTeX
@article{Li2024,
  author = {Li, Xue and He, Hui and Shi, Jin},
  title = {HDCCT: Hybrid Densely Connected CNN and Transformer for Infrared and Visible Image Fusion},
  journal = {Electronics},
  year = {2024},
  volume = {13},
  number = {17},
  pages = {3470},
  doi = {10.3390/electronics13173470}
}
Kostenlos starten →