3D-ViT-UNet: 3D Vision transformer based Unet-like model for Volumetric Brain Tumor Segmentation
PLOS Digital Health · 31.03.2026 · 5 (3) · e0001323
DOI: 10.1371/journal.pdig.0001323 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS Digital Health, online erschienen am 31.03.2026. Verfasst von Sikandar Afridi und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electrical Engineering, University of Engineering and Technology, Peshawar, Pakistan. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 66 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Accurate volumetric segmentation of 3D medical imaging modalities is critical for therapy planning and clinical diagnosis, particularly for brain tumor delineation. Traditional convolutional neural network (CNN)-based architectures face challenges while capturing global contextual information and modeling long-range dependencies in complex 3D volumetric data, limiting their segmentation performance. Transformer-based models have emerged as promising alternatives to CNNs for such tasks, addressing their limitations in capturing global spatial dependencies. We propose 3D-ViT-UNet, a novel U-shaped vision transformer (ViT)-based encoder-decoder architecture for end-to-end volumetric brain tumor segmentation. The model employs 3D Window Multi-Head Self-Attention (3D-W-MSA) to capture local features and a 3D Dilated-Window Multi-Head Self-Attention (3D-DW-MSA) to capture global features while reducing computational complexity. Moreover, for preserving absolute and relative positional information and preventing permutation equivalence limitation in transformers, a dynamic position encoding strategy is integrated. The proposed model demonstrates state-of-the-art (SOTA) performance for brain tumor segmentation on the BraTS 2020 dataset. It achieves a superior average Dice Similarity Coefficient (DSC) of 84.81% and a Hausdorff Distance (HD) of 4.87 mm with reduced computational complexity compared to existing methods. Also, an improvement in delineation of tumor boundaries and accurate segmentation across modalities is demonstrated through the qualitative results. Extensive quantitative and qualitative evaluations highlight the capability of 3D-ViT-UNet to achieve high accuracy with a smaller model size and lower FLOPs, making it an effective and efficient solution for clinical applications involving volumetric brain tumor segmentation.
Autor:innen und Institutionen
- Department of Electrical Engineering, University of Engineering and Technology, Peshawar, Pakistan.
- School of Computer Science, Technological University Dublin (TU Dublin), Dublin, Ireland.
ORCID-Profile: Muhammad Abeer Irfan
Zitieren
APA
Afridi, S., Jan, A., Irfan, M. A., Khattak, M. I., & Khan, T. A. (2026). 3D-ViT-UNet: 3D Vision transformer based Unet-like model for Volumetric Brain Tumor Segmentation. PLOS Digital Health, 5(3), e0001323. https://doi.org/10.1371/journal.pdig.0001323
Vancouver
Afridi S, Jan A, Irfan MA, Khattak MI, Khan TA. 3D-ViT-UNet: 3D Vision transformer based Unet-like model for Volumetric Brain Tumor Segmentation. PLOS Digital Health. 2026;5(3):e0001323. doi:10.1371/journal.pdig.0001323
BibTeX
@article{Afridi2026,
author = {Afridi, Sikandar and Jan, Atif and Irfan, Muhammad Abeer and Khattak, Muhammad Irfan and Khan, Taimur Ahmed},
title = {3D-ViT-UNet: 3D Vision transformer based Unet-like model for Volumetric Brain Tumor Segmentation},
journal = {PLOS Digital Health},
year = {2026},
volume = {5},
number = {3},
pages = {e0001323},
doi = {10.1371/journal.pdig.0001323}
}
EUVIMED