EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Fast and Accurate Facial Expression Image Classification and Regression Method Based on Knowledge Distillation

Kunyoung Lee, Seunghyun Kim, Eui Chul Lee

Applied Sciences · 24.05.2023 · 13 (11) · 6409

DOI: 10.3390/app13116409 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 24.05.2023. Verfasst von Kunyoung Lee und 2 weiteren Autor:innen. Die Arbeit wurde bisher 29-mal zitiert (Crossref) und nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

As emotional states are diverse, simply classifying them through discrete facial expressions has its limitations. Therefore, to create a facial expression recognition system for practical applications, not only must facial expressions be classified, emotional changes must be measured as continuous values. Based on the knowledge distillation structure and the teacher-bounded loss function, we propose a method to maximize the synergistic effect of jointly learning discrete and continuous emotional states of eight expression classes, valences, and arousal levels. The proposed knowledge distillation model uses Emonet, a state-of-the-art continuous estimation method, as the teacher model, and uses a lightweight network as the student model. It was confirmed that performance degradation can be minimized even though student models have multiply-accumulate operations of approximately 3.9 G and 0.3 G when using EfficientFormer and MobileNetV2, respectively, which is much less than the amount of computation required by the teacher model (16.99 G). Together with the significant improvements in computational efficiency (by 4.35 and 56.63 times using EfficientFormer and MobileNetV2, respectively), the decreases in facial expression classification accuracy were approximately 1.35% and 1.64%, respectively. Therefore, the proposed method is optimized for application-level interaction systems in terms of both the amount of computation required and the accuracy.

Zitieren

APA

Lee, K., Kim, S., & Lee, E. C. (2023). Fast and Accurate Facial Expression Image Classification and Regression Method Based on Knowledge Distillation. Applied Sciences, 13(11), 6409. https://doi.org/10.3390/app13116409

Vancouver

Lee K, Kim S, Lee EC. Fast and Accurate Facial Expression Image Classification and Regression Method Based on Knowledge Distillation. Applied Sciences. 2023;13(11):6409. doi:10.3390/app13116409

BibTeX
@article{Lee2023,
  author = {Lee, Kunyoung and Kim, Seunghyun and Lee, Eui Chul},
  title = {Fast and Accurate Facial Expression Image Classification and Regression Method Based on Knowledge Distillation},
  journal = {Applied Sciences},
  year = {2023},
  volume = {13},
  number = {11},
  pages = {6409},
  doi = {10.3390/app13116409}
}
Kostenlos starten →