A Hybrid Vision Transformer and EfficientNet-B3 Framework for Facial Expression Recognition
Journal of Imaging · 07.08.2026 · 12 (8) · 360
DOI: 10.3390/jimaging12080360 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Imaging, online erschienen am 07.08.2026. Verfasst von Sasan Karamizadeh und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Computer, Ershad Damavand Institute of Higher Education, Tehran 1416834311, Iran. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Facial expression recognition technology is vital for security, verification, and personalization, but it faces challenges due to variations in scale, illumination, occlusion, and facial expressions. This paper presents a hybrid architecture that combines Vision Transformers (ViTs) to capture global context with EfficientNet-B3 for multi-scale feature extraction. Unlike simple concatenation, our approach projects the ViT’s [CLS] token and the EfficientNet’s global pooling features into a shared 512-dimensional space before merging, enabling better alignment of global and local features. When tested on the FERPlus dataset, it reaches an accuracy of 94.4 ± 0.3%, surpassing several recent methods, notably existing transformer- and CNN-based methods. Ablation studies show each component’s contribution, with the full model outperforming the no-fusion version by 2.6%. With around 98 million parameters and an inference time of ~23 ms per image, it balances efficiency and high performance, suitable for real-time use on suitable hardware. Evaluation via confusion matrix, t-SNE visualization, and comparisons with recent techniques such as HLA-ViT (90.13%), AU-ViT (90.15%), and CCFER (91.24%) demonstrates its robustness and discriminative feature learning. This work highlights the promise of hybrid deep learning architectures in tackling real-world facial expression recognition challenges.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Computer, Ershad Damavand Institute of Higher Education, Tehran 1416834311, Iran.
- Department of Cybersecurity, Sydney International School of Technology and Commerce, Sydney, NSW 2000, Australia.
- Department of Computer Science and Technology, College of Arts and Sciences, State University of New York-Empire State University, New York, NY 10016, USA.
ORCID-Profile: Sasan Karamizadeh, Saman Shojae Chaeikar
Zitieren
APA
Karamizadeh, S., Shojae Chaeikar, S., & Zamani, M. (2026). A Hybrid Vision Transformer and EfficientNet-B3 Framework for Facial Expression Recognition. Journal of Imaging, 12(8), 360. https://doi.org/10.3390/jimaging12080360
Vancouver
Karamizadeh S, Shojae Chaeikar S, Zamani M. A Hybrid Vision Transformer and EfficientNet-B3 Framework for Facial Expression Recognition. Journal of Imaging. 2026;12(8):360. doi:10.3390/jimaging12080360
BibTeX
@article{Karamizadeh2026,
author = {Karamizadeh, Sasan and Shojae Chaeikar, Saman and Zamani, Mazdak},
title = {A Hybrid Vision Transformer and EfficientNet-B3 Framework for Facial Expression Recognition},
journal = {Journal of Imaging},
year = {2026},
volume = {12},
number = {8},
pages = {360},
doi = {10.3390/jimaging12080360}
}
EUVIMED