Structure-Aware Attention Prototype Network for Cross-Modality Few-Shot Brain Tumor Segmentation
IEEE Transactions on Pattern Analysis and Machine Intelligence · 2026
DOI: 10.1109/tpami.2026.3717881 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2026. Verfasst von Liang Sun und 7 weiteren Autor:innen. Hauptthemen laut MEDLINE: Magnetic Resonance Imaging, Brain Neoplasms, Image Interpretation, Computer-Assisted. Die Arbeit nennt 52 Literaturangaben. Gefördert von: National Natural Science Foundation of China, National Key R&D Program of China, Guangdong Basic and Applied Basic Research Foundation.
Abstract (Originalsprache)
Multi-modal magnetic resonance imaging (MRI) plays a crucial role in brain tumor diagnosis. However, the substantial physiological sensitivity discrepancies across imaging modalities create a severe domain gap that challenges current cross-modality segmentation methods. Many unsupervised domain adaptation (UDA) approaches reduce this gap through image style translation or distribution alignment, which have shown promising results but may struggle to preserve modality-specific anatomical and pathological information. In contrast, few-shot segmentation (FSS) provides a promising alternative paradigm with strong cross-domain generalization capability, avoiding explicit domain alignment. Therefore, in this work, we propose a novel Structure-aware Attention Prototype Network (SAPNet) for cross-modality few-shot brain tumor segmentation, which fully exploits task-agnostic, multi-scale features from the large vision model. Specifically, our SAPNet consists of three main components. First, we introduce a masked support feature reconstruction (MSFR) module to encourage the network to understand anatomically meaningful structures. Second, a patch-level attention-to-prototype alignment (APA) module is proposed to adaptively balance the aggressive and conservative segmentation tendencies by cross-attention (CA) and prototype-based learning. Third, a lightweight multi-scale decoder with the contrastive embedding space is employed to enhance fine-grained pixel-level prediction. Extensive experiments on three public benchmarks, BraTS 2020, VS-SEG, and BraTS 2023 PED datasets, demonstrate that SAPNet consistently outperforms state-of-the-art UDA and FSS methods, exhibiting strong generalization and robustness.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Förderung
- National Natural Science Foundation of China
- National Key R&D Program of China
- Guangdong Basic and Applied Basic Research Foundation
- Shenzhen Longhua Science and Technology Innovation Special Funding Project
Zitieren
APA
Sun, L., Zhu, L., Zhao, J., Fan, D., Wang, M., Huang, J., Shao, W., & Zhang, D. (2026). Structure-Aware Attention Prototype Network for Cross-Modality Few-Shot Brain Tumor Segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence. https://doi.org/10.1109/tpami.2026.3717881
Vancouver
Sun L, Zhu L, Zhao J, Fan D, Wang M, Huang J, et al. Structure-Aware Attention Prototype Network for Cross-Modality Few-Shot Brain Tumor Segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2026. doi:10.1109/tpami.2026.3717881
BibTeX
@article{Sun2026,
author = {Sun, Liang and Zhu, Lingyao and Zhao, Junyong and Fan, Dingwei and Wang, Mingliang and Huang, Jiashuang and Shao, Wei and Zhang, Daoqiang},
title = {Structure-Aware Attention Prototype Network for Cross-Modality Few-Shot Brain Tumor Segmentation},
journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
year = {2026},
doi = {10.1109/tpami.2026.3717881}
}
EUVIMED