EUVIMEDEUVIMED entdecken
ÜbersichtsarbeitOpen Access · CC BY 4.0

A Review of Deep Learning Methods for Multimodal Medical Image Fusion

Yanan Shi, Maria Rigou iD

Sensors · 22.07.2026 · 26 (14) · 4632

DOI: 10.3390/s26144632 ↗

Kurz gefasst

Übersichtsarbeit in der Zeitschrift Sensors, online erschienen am 22.07.2026. Verfasst von Yanan Shi und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Management Science and Technology, University of Patras, 26334 Patras, Greece. Hauptthemen laut MEDLINE: Deep Learning, Multimodal Imaging, Image Processing, Computer-Assisted. Die Arbeit nennt 93 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Research Council of the University of Patras.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multimodal medical image fusion (MMIF) aims to integrate complementary information from different imaging modalities into a single, more informative image to support clinical diagnosis. Since 2017, a growing number of deep learning-based approaches have been proposed for MMIF, including various network architectures designed to enhance visual quality. However, a comprehensive and up-to-date review of deep learning-based MMIF techniques is still lacking. To fill this gap, this paper provides a comprehensive survey of deep learning-based MMIF methods. First, we categorize MMIF approaches based on deep learning frameworks and conduct an in-depth analysis of loss functions, evaluation metrics, medical imaging modality pairs, and medical datasets. Then, we review the mainstream deep learning-based MMIF methods, including CNNs, Autoencoders, GANs, and Transformers. Subsequently, we introduce emerging deep learning methods, including diffusion models and Mamba-based methods. In addition, we summarize widely used datasets and evaluation metrics, conduct quantitative experiments on representative methods, and propose a unified set of evaluation metrics for standardized comparison. Finally, we identify key research challenges and outline promising future directions for deep learning-based MMIF. This survey aims to provide researchers with a clear understanding of recent progress in deep learning-based MMIF and to facilitate further studies in this area.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Deep LearningMultimodal ImagingImage Processing, Computer-AssistedHumansConvolutional Neural NetworksAutoencoderGenerative Adversarial NetworksAlgorithms

Stichwörter der Autor:innen

deep learningmedical image fusionmultimodal fusionreview

Autor:innen und Institutionen

  • Department of Management Science and Technology, University of Patras, 26334 Patras, Greece.

ORCID-Profile: Maria Rigou

Förderung

  • Research Council of the University of Patras

Zitieren

APA

Shi, Y., & Rigou, M. (2026). A Review of Deep Learning Methods for Multimodal Medical Image Fusion. Sensors, 26(14), 4632. https://doi.org/10.3390/s26144632

Vancouver

Shi Y, Rigou M. A Review of Deep Learning Methods for Multimodal Medical Image Fusion. Sensors. 2026;26(14):4632. doi:10.3390/s26144632

BibTeX
@article{Shi2026,
  author = {Shi, Yanan and Rigou, Maria},
  title = {A Review of Deep Learning Methods for Multimodal Medical Image Fusion},
  journal = {Sensors},
  year = {2026},
  volume = {26},
  number = {14},
  pages = {4632},
  doi = {10.3390/s26144632}
}
Kostenlos starten →