EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Hybrid CNN–transformer model with gated feature fusion and GAN-based augmentation for MRI image classification

Sedat Orenc, Cebrail Turkeri, Yusuf Alaca

Die Radiologie · 02.11.2026

DOI: 10.1007/s00117-026-01681-9 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Die Radiologie, online erschienen am 02.11.2026. Verfasst von Sedat Orenc und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electrical and Electronics Engineering, Batman University, Batman, Turkey. Die Arbeit nennt 47 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Objective

Brain tumor classification based on magnetic resonance imaging (MRI) plays a critical role in clinical diagnosis, yet it remains challenging due to high intra-class variability, inter-class similarity, and limited annotated data. To address these challenges, this study proposes a gated hybrid convolutional neural network (CNN)–transformer architecture (GHCT-Net) that effectively integrates local and global feature representations for robust brain tumor classification in data-limited medical imaging scenarios.

Methods

The proposed framework combines a ConvNeXt-based convolutional branch for fine-grained spatial feature extraction with a Swin Transformer branch for modeling long-range contextual dependencies. A gate-based fusion mechanism is introduced to adaptively balance the contribution of each feature stream. Additionally, a conditional deep convolutional generative adversarial network (cDCGAN) is employed to generate class-consistent synthetic MRI samples to mitigate data scarcity. The model was evaluated on a public dataset of 7023 MRI images across four classes (glioma, meningioma, pituitary tumor, and no tumor) under three training scenarios: original, traditionally augmented, and GAN-augmented datasets.

Results

The results demonstrate that the GHCT-Net achieves superior performance compared to state-of-the-art CNN and Transformer architectures, reaching a classification accuracy of 98.39% on the GAN-augmented dataset. Quantitative analysis, along with confusion matrices, t‑distributed stochastic neighbor embedding (t-SNE) visualizations, and gradient-weighted class activation mapping (Grad-CAM) interpretability studies, confirms that the model successfully learns discriminative and clinically relevant features.

Conclusion

Combining a gated hybrid CNN–transformer architecture with GAN-based data augmentation provides a highly effective and robust solution for brain tumor classification, particularly in scenarios constrained by limited medical imaging data.

Schlagwörter

Stichwörter der Autor:innen

Brain tumor classificationDeep learningHybrid CNN–TransformerMagnetic resonance imagingMedical image analysis

Autor:innen und Institutionen

  • Department of Electrical and Electronics Engineering, Batman University, Batman, Turkey.
  • Department of Computer Engineering, Batman University, Batman, Turkey. cebrail.turkeri@batman.edu.tr.
  • University of Warwick, Coventry, United Kingdom. cebrail.turkeri@batman.edu.tr.
  • Department of Computer Engineering, Hitit University, Corum, Turkey.

Zitieren

APA

Orenc, S., Turkeri, C., & Alaca, Y. (2026). Hybrid CNN–transformer model with gated feature fusion and GAN-based augmentation for MRI image classification. Die Radiologie. https://doi.org/10.1007/s00117-026-01681-9

Vancouver

Orenc S, Turkeri C, Alaca Y. Hybrid CNN–transformer model with gated feature fusion and GAN-based augmentation for MRI image classification. Die Radiologie. 2026. doi:10.1007/s00117-026-01681-9

BibTeX
@article{Orenc2026,
  author = {Orenc, Sedat and Turkeri, Cebrail and Alaca, Yusuf},
  title = {Hybrid CNN–transformer model with gated feature fusion and GAN-based augmentation for MRI image classification},
  journal = {Die Radiologie},
  year = {2026},
  doi = {10.1007/s00117-026-01681-9}
}
Kostenlos starten →