EUVIMEDEUVIMED entdecken
Crossref

Diffusion-driven multi-modality medical image fusion

Jiantao Qu, Dongjin Huang, Yongsheng Shi, Jinhua Liu, Wen Tang

Medical & Biological Engineering & Computing · 2025-07 · 63 (7) · 2105-2118

DOI: 10.1007/s11517-025-03300-6 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Medical & Biological Engineering & Computing, online erschienen am 11.02.2025. Verfasst von Jiantao Qu und 4 weiteren Autor:innen. Beteiligte Einrichtung: Shanghai Film Academy, Shanghai University, Shanghai, 200072, China. Hauptthemen laut MEDLINE: Multimodal Imaging, Image Processing, Computer-Assisted. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 43 Literaturangaben. Gefördert von: Shanghai Talent Development Funding of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multi-modality medical image fusion (MMIF) technology utilizes the complementarity of different modalities to provide more comprehensive diagnostic insights for clinical practice. Existing deep learning-based methods often focus on extracting the primary information from individual modalities while ignoring the correlation of information distribution across different modalities, which leads to insufficient fusion of image details and color information. To address this problem, a diffusion-driven MMIF method is proposed to leverage the information distribution relationship among multi-modality images in the latent space. To better preserve the complementary information from different modalities, a local and global network (LAGN) is suggested. Additionally, a loss strategy is designed to establish robust constraints among diffusion-generated images, original images, and fused images. This strategy supervises the training process and prevents information loss in fused images. The experimental results demonstrate that the proposed method surpasses state-of-the-art image fusion methods in terms of unsupervised metrics on three datasets: MRI/CT, MRI/PET, and MRI/SPECT images. The proposed method successfully captures rich details and color information. Furthermore, 16 doctors and medical students were invited to evaluate the effectiveness of our method in assisting clinical diagnosis and treatment.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Multimodal ImagingImage Processing, Computer-AssistedHumansDeep LearningMagnetic Resonance ImagingAlgorithmsTomography, X-Ray ComputedTomography, Emission-Computed, Single-Photon

Stichwörter der Autor:innen

Deep learningDiffusionLocal and global fusionMedical image fusion

Autor:innen und Institutionen

  • Shanghai Film Academy, Shanghai University, Shanghai, 200072, China.
  • Shanghai Film Academy, Shanghai University, Shanghai, 200072, China. djhuang@shu.edu.cn.
  • Department of Creative Technology, Bournemouth University, Poole, BH12 5BB, UK.

Förderung

  • Shanghai Talent Development Funding of China

Zitieren

APA

Qu, J., Huang, D., Shi, Y., Liu, J., & Tang, W. (2025). Diffusion-driven multi-modality medical image fusion. Medical & Biological Engineering & Computing, 63(7), 2105-2118. https://doi.org/10.1007/s11517-025-03300-6

Vancouver

Qu J, Huang D, Shi Y, Liu J, Tang W. Diffusion-driven multi-modality medical image fusion. Medical & Biological Engineering & Computing. 2025;63(7):2105-2118. doi:10.1007/s11517-025-03300-6

BibTeX
@article{Qu2025,
  author = {Qu, Jiantao and Huang, Dongjin and Shi, Yongsheng and Liu, Jinhua and Tang, Wen},
  title = {Diffusion-driven multi-modality medical image fusion},
  journal = {Medical & Biological Engineering & Computing},
  year = {2025},
  volume = {63},
  number = {7},
  pages = {2105--2118},
  doi = {10.1007/s11517-025-03300-6}
}
Kostenlos starten →