EUVIMEDEUVIMED entdecken
Crossref

Cross-Modality Interaction Network for Medical Image Fusion

Wenhao Song, Xiangqin Zeng, Ahmed M. Abdelmoniem, Housheng Zhang, Mingliang Gao

IEEE Transactions on Consumer Electronics · 2025-02 · 71 (1) · 1385-1392

DOI: 10.1109/tce.2024.3412879 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Consumer Electronics, 2025-02. Verfasst von Wenhao Song und 4 weiteren Autor:innen. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 28 Literaturangaben. Gefördert von: Project of Shandong Province Graduate High-Quality Education and Teaching Resources.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multi-modal medical image fusion maximizes the complementary information from diverse modality images by integrating source images. The fused medical image could offer enhanced richness and improved accuracy compared to the source images. Unfortunately, the existing deep learning-based medical image fusion methods generally rely on convolutional operations, which may not effectively capture global information such as spatial relationships or shape features within and across image modalities. To address this problem, we propose a unified AI-Generated Content (AIGC)-based medical image fusion, termed Cross-Modal Interactive Network (CMINet). The CMINet integrates a recursive transformer with an interactive Convolutional Neural Network. Specifically, the recursive transformer is designed to capture extended spatial and temporal dependencies within modalities, while the interactive CNN aims to extract and merge local features across modalities. Benefiting from cross-modality interaction learning, the proposed method can generate fused images with rich structural and functional information. Additionally, the architecture of the recursive network is structured to reduce parameter count, which could be beneficial for deployment on resource-constrained devices. Comprehensive experiments on multi-model medical images (MRI and CT, MRI and PET, and MRI and SPECT) demonstrate that the proposed method outperforms the state-of-the-art fusion methods subjectively and objectively.

Förderung

  • Project of Shandong Province Graduate High-Quality Education and Teaching Resources

Zitieren

APA

Song, W., Zeng, X., Abdelmoniem, A. M., Zhang, H., & Gao, M. (2025). Cross-Modality Interaction Network for Medical Image Fusion. IEEE Transactions on Consumer Electronics, 71(1), 1385-1392. https://doi.org/10.1109/tce.2024.3412879

Vancouver

Song W, Zeng X, Abdelmoniem AM, Zhang H, Gao M. Cross-Modality Interaction Network for Medical Image Fusion. IEEE Transactions on Consumer Electronics. 2025;71(1):1385-1392. doi:10.1109/tce.2024.3412879

BibTeX
@article{Song2025,
  author = {Song, Wenhao and Zeng, Xiangqin and Abdelmoniem, Ahmed M. and Zhang, Housheng and Gao, Mingliang},
  title = {Cross-Modality Interaction Network for Medical Image Fusion},
  journal = {IEEE Transactions on Consumer Electronics},
  year = {2025},
  volume = {71},
  number = {1},
  pages = {1385--1392},
  doi = {10.1109/tce.2024.3412879}
}
Kostenlos starten →