EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Comparative Analysis of Vision Transformer Models for Facial Emotion Recognition Using Augmented Balanced Datasets

Sukhrob Bobojanov, Byeong Man Kim, Mukhriddin Arabboev, Shohruh Begmatov

Applied Sciences · 13.11.2023 · 13 (22) · 12271

DOI: 10.3390/app132212271 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 13.11.2023. Verfasst von Sukhrob Bobojanov und 3 weiteren Autor:innen. Die Arbeit wurde bisher 30-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Facial emotion recognition (FER) has a huge importance in the field of human–machine interface. Given the intricacies of human facial expressions and the inherent variations in images, which are characterized by diverse facial poses and lighting conditions, the task of FER remains a challenging endeavour for computer-based models. Recent advancements have seen vision transformer (ViT) models attain state-of-the-art results across various computer vision tasks, encompassing image classification, object detection, and segmentation. Moreover, one of the most important aspects of creating strong machine learning models is correcting data imbalances. To avoid biased predictions and guarantee reliable findings, it is essential to maintain the distribution equilibrium of the training dataset. In this work, we have chosen two widely used open-source datasets, RAF-DB and FER2013. As well as resolving the imbalance problem, we present a new, balanced dataset, applying data augmentation techniques and cleaning poor-quality images from the FER2013 dataset. We then conduct a comprehensive evaluation of thirteen different ViT models with these three datasets. Our investigation concludes that ViT models present a promising approach for FER tasks. Among these ViT models, Mobile ViT and Tokens-to-Token ViT models appear to be the most effective, followed by PiT and Cross Former models.

Zitieren

APA

Bobojanov, S., Kim, B. M., Arabboev, M., & Begmatov, S. (2023). Comparative Analysis of Vision Transformer Models for Facial Emotion Recognition Using Augmented Balanced Datasets. Applied Sciences, 13(22), 12271. https://doi.org/10.3390/app132212271

Vancouver

Bobojanov S, Kim BM, Arabboev M, Begmatov S. Comparative Analysis of Vision Transformer Models for Facial Emotion Recognition Using Augmented Balanced Datasets. Applied Sciences. 2023;13(22):12271. doi:10.3390/app132212271

BibTeX
@article{Bobojanov2023,
  author = {Bobojanov, Sukhrob and Kim, Byeong Man and Arabboev, Mukhriddin and Begmatov, Shohruh},
  title = {Comparative Analysis of Vision Transformer Models for Facial Emotion Recognition Using Augmented Balanced Datasets},
  journal = {Applied Sciences},
  year = {2023},
  volume = {13},
  number = {22},
  pages = {12271},
  doi = {10.3390/app132212271}
}
Kostenlos starten →