EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Hybrid Vision Transformer and EfficientNet-B3 Framework for Facial Expression Recognition

Sasan Karamizadeh iD, Saman Shojae Chaeikar iD, Mazdak Zamani

Journal of Imaging · 07.08.2026 · 12 (8) · 360

DOI: 10.3390/jimaging12080360 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Imaging, online erschienen am 07.08.2026. Verfasst von Sasan Karamizadeh und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Computer, Ershad Damavand Institute of Higher Education, Tehran 1416834311, Iran. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Facial expression recognition technology is vital for security, verification, and personalization, but it faces challenges due to variations in scale, illumination, occlusion, and facial expressions. This paper presents a hybrid architecture that combines Vision Transformers (ViTs) to capture global context with EfficientNet-B3 for multi-scale feature extraction. Unlike simple concatenation, our approach projects the ViT’s [CLS] token and the EfficientNet’s global pooling features into a shared 512-dimensional space before merging, enabling better alignment of global and local features. When tested on the FERPlus dataset, it reaches an accuracy of 94.4 ± 0.3%, surpassing several recent methods, notably existing transformer- and CNN-based methods. Ablation studies show each component’s contribution, with the full model outperforming the no-fusion version by 2.6%. With around 98 million parameters and an inference time of ~23 ms per image, it balances efficiency and high performance, suitable for real-time use on suitable hardware. Evaluation via confusion matrix, t-SNE visualization, and comparisons with recent techniques such as HLA-ViT (90.13%), AU-ViT (90.15%), and CCFER (91.24%) demonstrates its robustness and discriminative feature learning. This work highlights the promise of hybrid deep learning architectures in tackling real-world facial expression recognition challenges.

Schlagwörter

Stichwörter der Autor:innen

EfficientNet-B3FERPlus datasetVision Transformers (ViTs)deep learningfacial expression recognition

Autor:innen und Institutionen

  • Department of Computer, Ershad Damavand Institute of Higher Education, Tehran 1416834311, Iran.
  • Department of Cybersecurity, Sydney International School of Technology and Commerce, Sydney, NSW 2000, Australia.
  • Department of Computer Science and Technology, College of Arts and Sciences, State University of New York-Empire State University, New York, NY 10016, USA.

ORCID-Profile: Sasan Karamizadeh, Saman Shojae Chaeikar

Zitieren

APA

Karamizadeh, S., Shojae Chaeikar, S., & Zamani, M. (2026). A Hybrid Vision Transformer and EfficientNet-B3 Framework for Facial Expression Recognition. Journal of Imaging, 12(8), 360. https://doi.org/10.3390/jimaging12080360

Vancouver

Karamizadeh S, Shojae Chaeikar S, Zamani M. A Hybrid Vision Transformer and EfficientNet-B3 Framework for Facial Expression Recognition. Journal of Imaging. 2026;12(8):360. doi:10.3390/jimaging12080360

BibTeX
@article{Karamizadeh2026,
  author = {Karamizadeh, Sasan and Shojae Chaeikar, Saman and Zamani, Mazdak},
  title = {A Hybrid Vision Transformer and EfficientNet-B3 Framework for Facial Expression Recognition},
  journal = {Journal of Imaging},
  year = {2026},
  volume = {12},
  number = {8},
  pages = {360},
  doi = {10.3390/jimaging12080360}
}
Kostenlos starten →