MMAformer: Multiscale Modality-Aware Transformer for Medical Image Segmentation
Electronics · 25.11.2024 · 13 (23) · 4636
DOI: 10.3390/electronics13234636 ↗Kurz gefasst
Fachartikel in der Zeitschrift Electronics, online erschienen am 25.11.2024. Verfasst von Hao Ding und 4 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 42 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, General Research Fund of Shanghai Normal University.
Abstract (Originalsprache)
The segmentation of medical images, particularly for brain tumors, is essential for clinical diagnosis and treatment planning. In this study, we proposed MMAformer, a Multiscale Modality-Aware Transformer model, which is designed for segmenting brain tumors by utilizing multimodality magnetic resonance imaging (MRI). Complementary information between different sequences helps the model delineate tumor boundaries and distinguish different tumor tissues. To enable the model to acquire the complementary information between related sequences, MMAformer employs a multistage encoder, which uses a cross-modal downsampling (CMD) block for learning and integrating the complementary information between sequences at different scales. In order to effectively fuse the various information extracted by the encoder, the Multimodal Gated Aggregation (MGA) block combines the dual attention mechanism and multi-gated clustering to effectively fuse the spatial, channel, and modal features of different MRI sequences. In the comparison experiments on the BraTS2020 and BraTS2021 datasets, the average Dice score of MMAformer reached 86.3% and 91.53%, respectively, indicating that MMAformer surpasses the current state-of-the-art approaches. MMAformer’s innovative architecture, which effectively captures and integrates multimodal information at various scales, offers a promising solution for tackling complex medical image segmentation challenges.
Förderung
- National Natural Science Foundation of China
- General Research Fund of Shanghai Normal University
Zitieren
APA
Ding, H., Zhang, X., Lu, W., Yuan, F., & Luo, H. (2024). MMAformer: Multiscale Modality-Aware Transformer for Medical Image Segmentation. Electronics, 13(23), 4636. https://doi.org/10.3390/electronics13234636
Vancouver
Ding H, Zhang X, Lu W, Yuan F, Luo H. MMAformer: Multiscale Modality-Aware Transformer for Medical Image Segmentation. Electronics. 2024;13(23):4636. doi:10.3390/electronics13234636
BibTeX
@article{Ding2024,
author = {Ding, Hao and Zhang, Xiangfen and Lu, Wenhao and Yuan, Feiniu and Luo, Haixia},
title = {MMAformer: Multiscale Modality-Aware Transformer for Medical Image Segmentation},
journal = {Electronics},
year = {2024},
volume = {13},
number = {23},
pages = {4636},
doi = {10.3390/electronics13234636}
}
EUVIMED