EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A high‐performance and lightweight framework for real‐time facial expression recognition

Xuebin Xu, Chenguang Liu, Shuxin Cao, Longbin Lu

IET Image Processing · 2023-10 · 17 (12) · 3500-3509

DOI: 10.1049/ipr2.12881 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IET Image Processing, online erschienen am 26.07.2023. Verfasst von Xuebin Xu und 3 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 52 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Education Department of Shaanxi Province, Science and Technology Innovation as a Whole Plan Projects of Shaanxi Province, Key Research and Development Projects of Shaanxi Province.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Facial expression recognition technology has become a powerful tool for conveying human emotions and intentions and is widely used in areas such as assisted driving and intelligent medical care. Due to the limited computing power of current hardware devices and the real‐time requirements of application scenarios, this paper proposes a high‐performance and lightweight framework for real‐time facial expression recognition framework to solve the problem of real‐time completion of expression recognition tasks under low hardware costs. To address these issues, this paper first designs a RepVGG and mobileNetV2 dual‐channel structure in the feature extraction. It is then input into the MobileViT Block for global feature modelling. Finally, the position vector of the capsule network is used to replace the output of the global pooling, preserving the spatial relationship of the salient features and enhancing the classification effect. Compared with the mainstream facial expression recognition algorithm that cannot get good classification results under low complexity conditions, the model has a significant accuracy improvement while ensuring lightweight. With only 294.60M FLOPS and 0.95M parameters, it achieved an accuracy of 97.53% on the KDEF dataset and 85.56% on the RAF‐DB, demonstrating the advanced nature of the algorithm.

Förderung

  • Education Department of Shaanxi Province
  • Science and Technology Innovation as a Whole Plan Projects of Shaanxi Province
  • Key Research and Development Projects of Shaanxi Province
  • National Natural Science Foundation of China

Zitieren

APA

Xu, X., Liu, C., Cao, S., & Lu, L. (2023). A high‐performance and lightweight framework for real‐time facial expression recognition. IET Image Processing, 17(12), 3500-3509. https://doi.org/10.1049/ipr2.12881

Vancouver

Xu X, Liu C, Cao S, Lu L. A high‐performance and lightweight framework for real‐time facial expression recognition. IET Image Processing. 2023;17(12):3500-3509. doi:10.1049/ipr2.12881

BibTeX
@article{Xu2023,
  author = {Xu, Xuebin and Liu, Chenguang and Cao, Shuxin and Lu, Longbin},
  title = {A high‐performance and lightweight framework for real‐time facial expression recognition},
  journal = {IET Image Processing},
  year = {2023},
  volume = {17},
  number = {12},
  pages = {3500--3509},
  doi = {10.1049/ipr2.12881}
}
Kostenlos starten →