Hybrid CNN–transformer model with gated feature fusion and GAN-based augmentation for MRI image classification
Die Radiologie · 02.11.2026
DOI: 10.1007/s00117-026-01681-9 ↗Kurz gefasst
Fachartikel in der Zeitschrift Die Radiologie, online erschienen am 02.11.2026. Verfasst von Sedat Orenc und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electrical and Electronics Engineering, Batman University, Batman, Turkey. Die Arbeit nennt 47 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Objective
Brain tumor classification based on magnetic resonance imaging (MRI) plays a critical role in clinical diagnosis, yet it remains challenging due to high intra-class variability, inter-class similarity, and limited annotated data. To address these challenges, this study proposes a gated hybrid convolutional neural network (CNN)–transformer architecture (GHCT-Net) that effectively integrates local and global feature representations for robust brain tumor classification in data-limited medical imaging scenarios.
Methods
The proposed framework combines a ConvNeXt-based convolutional branch for fine-grained spatial feature extraction with a Swin Transformer branch for modeling long-range contextual dependencies. A gate-based fusion mechanism is introduced to adaptively balance the contribution of each feature stream. Additionally, a conditional deep convolutional generative adversarial network (cDCGAN) is employed to generate class-consistent synthetic MRI samples to mitigate data scarcity. The model was evaluated on a public dataset of 7023 MRI images across four classes (glioma, meningioma, pituitary tumor, and no tumor) under three training scenarios: original, traditionally augmented, and GAN-augmented datasets.
Results
The results demonstrate that the GHCT-Net achieves superior performance compared to state-of-the-art CNN and Transformer architectures, reaching a classification accuracy of 98.39% on the GAN-augmented dataset. Quantitative analysis, along with confusion matrices, t‑distributed stochastic neighbor embedding (t-SNE) visualizations, and gradient-weighted class activation mapping (Grad-CAM) interpretability studies, confirms that the model successfully learns discriminative and clinically relevant features.
Conclusion
Combining a gated hybrid CNN–transformer architecture with GAN-based data augmentation provides a highly effective and robust solution for brain tumor classification, particularly in scenarios constrained by limited medical imaging data.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Electrical and Electronics Engineering, Batman University, Batman, Turkey.
- Department of Computer Engineering, Batman University, Batman, Turkey. cebrail.turkeri@batman.edu.tr.
- University of Warwick, Coventry, United Kingdom. cebrail.turkeri@batman.edu.tr.
- Department of Computer Engineering, Hitit University, Corum, Turkey.
Zitieren
APA
Orenc, S., Turkeri, C., & Alaca, Y. (2026). Hybrid CNN–transformer model with gated feature fusion and GAN-based augmentation for MRI image classification. Die Radiologie. https://doi.org/10.1007/s00117-026-01681-9
Vancouver
Orenc S, Turkeri C, Alaca Y. Hybrid CNN–transformer model with gated feature fusion and GAN-based augmentation for MRI image classification. Die Radiologie. 2026. doi:10.1007/s00117-026-01681-9
BibTeX
@article{Orenc2026,
author = {Orenc, Sedat and Turkeri, Cebrail and Alaca, Yusuf},
title = {Hybrid CNN–transformer model with gated feature fusion and GAN-based augmentation for MRI image classification},
journal = {Die Radiologie},
year = {2026},
doi = {10.1007/s00117-026-01681-9}
}
EUVIMED