EUVIMEDOntdek EUVIMED
Scoping ReviewOpen access

Transformers for Neuroimage Segmentation: Scoping Review

Maya Iratni iD, Amira Abdullah iD, Mariam Aldhaheri iD, Omar Elharrouss iD, Alaa Abd-Alrazaq iD, Zahiriddin Rustamov iD, Nazar Zaki iD, Rafat Damseh iD

Journal of Medical Internet Research · 2025

DOI: 10.2196/57723 ↗

At a glance

Scoping Review in Journal of Medical Internet Research, 2025. Written by Maya Iratni and 7 co-authors. Institution: Department of Computer Science and Software Engineering, United Arab Emirates University, Al Ain, United Arab Emirates. Major MEDLINE topics: Neuroimaging, Image Processing, Computer-Assisted. Cited 20 times so far (Crossref); 103 references. The full text is freely available in PubMed Central.

SamenvattingSubjectsBibliografische gegevensCiteRelated studies

Abstract (original language)

Background

Neuroimaging segmentation is increasingly important for diagnosing and planning treatments for neurological diseases. Manual segmentation is time-consuming, apart from being prone to human error and variability. Transformers are a promising deep learning approach for automated medical image segmentation.

Objective

This scoping review will synthesize current literature and assess the use of various transformer models for neuroimaging segmentation.

Methods

A systematic search in major databases, including Scopus, IEEE Xplore, PubMed, and ACM Digital Library, was carried out for studies applying transformers to neuroimaging segmentation problems from 2019 through 2023. The inclusion criteria allow only for peer-reviewed journal papers and conference papers focused on transformer-based segmentation of human brain imaging data. Excluded are the studies dealing with nonneuroimaging data or raw brain signals and electroencephalogram data. Data extraction was performed to identify key study details, including image modalities, datasets, neurological conditions, transformer models, and evaluation metrics. Results were synthesized using a narrative approach.

Results

Of the 1246 publications identified, 67 (5.38%) met the inclusion criteria. Half of all included studies were published in 2022, and more than two-thirds used transformers for segmenting brain tumors. The most common imaging modality was magnetic resonance imaging (n=59, 88.06%), while the most frequently used dataset was brain tumor segmentation dataset (n=39, 58.21%). 3D transformer models (n=42, 62.69%) were more prevalent than their 2D counterparts. The most developed were those of hybrid convolutional neural network-transformer architectures (n=57, 85.07%), where the vision transformer is the most frequently used type of transformer (n=37, 55.22%). The most frequent evaluation metric was the Dice score (n=63, 94.03%). Studies generally reported increased segmentation accuracy and the ability to model both local and global features in brain images.

Conclusions

This review represents the recent increase in the adoption of transformers for neuroimaging segmentation, particularly for brain tumor detection. Currently, hybrid convolutional neural network-transformer architectures achieve state-of-the-art performances on benchmark datasets over standalone models. Nevertheless, their applicability remains highly limited by high computational costs and potential overfitting on small datasets. The heavy reliance of the field on the brain tumor segmentation dataset hints at the use of a more diverse set of datasets to validate the performances of models on a variety of neurological diseases. Further research is needed to define the optimal transformer architectures and training methods for clinical applications. Continuing development may make transformers the state-of-the-art for fast, accurate, and reliable brain magnetic resonance imaging segmentation, which could lead to improved clinical tools for diagnosing and evaluating neurological disorders.

Subjects

MeSH terms (MEDLINE)

NeuroimagingImage Processing, Computer-AssistedHumansDeep LearningBrainBrain NeoplasmsMagnetic Resonance Imaging

Author keywords

3D segmentationbrain tumor segmentationdeep learningneuroimagingtransformer

Authors and institutions

  • Department of Computer Science and Software Engineering, United Arab Emirates University, Al Ain, United Arab Emirates.
  • Weill Cornell Medicine-Qatar, Doha, Qatar.

ORCID profiles: Maya Iratni, Amira Abdullah, Mariam Aldhaheri, Omar Elharrouss, Alaa Abd-Alrazaq, Zahiriddin Rustamov, Nazar Zaki, Rafat Damseh

Cite

APA

Iratni, M., Abdullah, A., Aldhaheri, M., Elharrouss, O., Abd-Alrazaq, A., Rustamov, Z., Zaki, N., & Damseh, R. (2025). Transformers for Neuroimage Segmentation: Scoping Review. Journal of Medical Internet Research. https://doi.org/10.2196/57723

Vancouver

Iratni M, Abdullah A, Aldhaheri M, Elharrouss O, Abd-Alrazaq A, Rustamov Z, et al. Transformers for Neuroimage Segmentation: Scoping Review. Journal of Medical Internet Research. 2025. doi:10.2196/57723

BibTeX
@article{Iratni2025,
  author = {Iratni, Maya and Abdullah, Amira and Aldhaheri, Mariam and Elharrouss, Omar and Abd-Alrazaq, Alaa and Rustamov, Zahiriddin and Zaki, Nazar and Damseh, Rafat},
  title = {Transformers for Neuroimage Segmentation: Scoping Review},
  journal = {Journal of Medical Internet Research},
  year = {2025},
  doi = {10.2196/57723}
}
Start for free →