Diffusion-driven multi-modality medical image fusion
Medical & Biological Engineering & Computing · 2025-07 · 63 (7) · 2105-2118
DOI: 10.1007/s11517-025-03300-6 ↗Kurz gefasst
Fachartikel in der Zeitschrift Medical & Biological Engineering & Computing, online erschienen am 11.02.2025. Verfasst von Jiantao Qu und 4 weiteren Autor:innen. Beteiligte Einrichtung: Shanghai Film Academy, Shanghai University, Shanghai, 200072, China. Hauptthemen laut MEDLINE: Multimodal Imaging, Image Processing, Computer-Assisted. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 43 Literaturangaben. Gefördert von: Shanghai Talent Development Funding of China.
Abstract (Originalsprache)
Multi-modality medical image fusion (MMIF) technology utilizes the complementarity of different modalities to provide more comprehensive diagnostic insights for clinical practice. Existing deep learning-based methods often focus on extracting the primary information from individual modalities while ignoring the correlation of information distribution across different modalities, which leads to insufficient fusion of image details and color information. To address this problem, a diffusion-driven MMIF method is proposed to leverage the information distribution relationship among multi-modality images in the latent space. To better preserve the complementary information from different modalities, a local and global network (LAGN) is suggested. Additionally, a loss strategy is designed to establish robust constraints among diffusion-generated images, original images, and fused images. This strategy supervises the training process and prevents information loss in fused images. The experimental results demonstrate that the proposed method surpasses state-of-the-art image fusion methods in terms of unsupervised metrics on three datasets: MRI/CT, MRI/PET, and MRI/SPECT images. The proposed method successfully captures rich details and color information. Furthermore, 16 doctors and medical students were invited to evaluate the effectiveness of our method in assisting clinical diagnosis and treatment.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Shanghai Film Academy, Shanghai University, Shanghai, 200072, China.
- Shanghai Film Academy, Shanghai University, Shanghai, 200072, China. djhuang@shu.edu.cn.
- Department of Creative Technology, Bournemouth University, Poole, BH12 5BB, UK.
Förderung
- Shanghai Talent Development Funding of China
Zitieren
APA
Qu, J., Huang, D., Shi, Y., Liu, J., & Tang, W. (2025). Diffusion-driven multi-modality medical image fusion. Medical & Biological Engineering & Computing, 63(7), 2105-2118. https://doi.org/10.1007/s11517-025-03300-6
Vancouver
Qu J, Huang D, Shi Y, Liu J, Tang W. Diffusion-driven multi-modality medical image fusion. Medical & Biological Engineering & Computing. 2025;63(7):2105-2118. doi:10.1007/s11517-025-03300-6
BibTeX
@article{Qu2025,
author = {Qu, Jiantao and Huang, Dongjin and Shi, Yongsheng and Liu, Jinhua and Tang, Wen},
title = {Diffusion-driven multi-modality medical image fusion},
journal = {Medical & Biological Engineering & Computing},
year = {2025},
volume = {63},
number = {7},
pages = {2105--2118},
doi = {10.1007/s11517-025-03300-6}
}
EUVIMED