A high‐performance and lightweight framework for real‐time facial expression recognition
IET Image Processing · 2023-10 · 17 (12) · 3500-3509
DOI: 10.1049/ipr2.12881 ↗Kurz gefasst
Fachartikel in der Zeitschrift IET Image Processing, online erschienen am 26.07.2023. Verfasst von Xuebin Xu und 3 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 52 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Education Department of Shaanxi Province, Science and Technology Innovation as a Whole Plan Projects of Shaanxi Province, Key Research and Development Projects of Shaanxi Province.
Abstract (Originalsprache)
Facial expression recognition technology has become a powerful tool for conveying human emotions and intentions and is widely used in areas such as assisted driving and intelligent medical care. Due to the limited computing power of current hardware devices and the real‐time requirements of application scenarios, this paper proposes a high‐performance and lightweight framework for real‐time facial expression recognition framework to solve the problem of real‐time completion of expression recognition tasks under low hardware costs. To address these issues, this paper first designs a RepVGG and mobileNetV2 dual‐channel structure in the feature extraction. It is then input into the MobileViT Block for global feature modelling. Finally, the position vector of the capsule network is used to replace the output of the global pooling, preserving the spatial relationship of the salient features and enhancing the classification effect. Compared with the mainstream facial expression recognition algorithm that cannot get good classification results under low complexity conditions, the model has a significant accuracy improvement while ensuring lightweight. With only 294.60M FLOPS and 0.95M parameters, it achieved an accuracy of 97.53% on the KDEF dataset and 85.56% on the RAF‐DB, demonstrating the advanced nature of the algorithm.
Förderung
- Education Department of Shaanxi Province
- Science and Technology Innovation as a Whole Plan Projects of Shaanxi Province
- Key Research and Development Projects of Shaanxi Province
- National Natural Science Foundation of China
Zitieren
APA
Xu, X., Liu, C., Cao, S., & Lu, L. (2023). A high‐performance and lightweight framework for real‐time facial expression recognition. IET Image Processing, 17(12), 3500-3509. https://doi.org/10.1049/ipr2.12881
Vancouver
Xu X, Liu C, Cao S, Lu L. A high‐performance and lightweight framework for real‐time facial expression recognition. IET Image Processing. 2023;17(12):3500-3509. doi:10.1049/ipr2.12881
BibTeX
@article{Xu2023,
author = {Xu, Xuebin and Liu, Chenguang and Cao, Shuxin and Lu, Longbin},
title = {A high‐performance and lightweight framework for real‐time facial expression recognition},
journal = {IET Image Processing},
year = {2023},
volume = {17},
number = {12},
pages = {3500--3509},
doi = {10.1049/ipr2.12881}
}
EUVIMED