Expression-Guided Deep Joint Learning for Facial Expression Recognition
Sensors · 13.08.2023 · 23 (16) · 7148
DOI: 10.3390/s23167148 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 13.08.2023. Verfasst von Bei Fang und 3 weiteren Autor:innen. Beteiligte Einrichtung: Key Laboratory of Modern Teaching Technology, Ministry of Education, Shaanxi Normal University, Xi'an 710062, China. Hauptthemen laut MEDLINE: Facial Recognition. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 72 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, China Postdoctoral Science Foundation, Ministry of Education in China project of humanities and social sciences.
Abstract (Originalsprache)
In recent years, convolutional neural networks (CNNs) have played a dominant role in facial expression recognition. While CNN-based methods have achieved remarkable success, they are notorious for having an excessive number of parameters, and they rely on a large amount of manually annotated data. To address this challenge, we expand the number of training samples by learning expressions from a face recognition dataset to reduce the impact of a small number of samples on the network training. In the proposed deep joint learning framework, the deep features of the face recognition dataset are clustered, and simultaneously, the parameters of an efficient CNN are learned, thereby marking the data for network training automatically and efficiently. Specifically, first, we develop a new efficient CNN based on the proposed affinity convolution module with much lower computational overhead for deep feature learning and expression classification. Then, we develop an expression-guided deep facial clustering approach to cluster the deep features and generate abundant expression labels from the face recognition dataset. Finally, the AC-based CNN is fine-tuned using an updated training set and a combined loss function. Our framework is evaluated on several challenging facial expression recognition datasets as well as a self-collected dataset. In the context of facial expression recognition applied to the field of education, our proposed method achieved an impressive accuracy of 95.87% on the self-collected dataset, surpassing other existing methods.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Key Laboratory of Modern Teaching Technology, Ministry of Education, Shaanxi Normal University, Xi'an 710062, China.
- Department of Information Construction and Management, Shaanxi Normal University, Xi'an 710061, China.
ORCID-Profile: Bei Fang
Förderung
- National Natural Science Foundation of China
- China Postdoctoral Science Foundation
- Ministry of Education in China project of humanities and social sciences
- Natural Science Basic Research Program of Shaanxi
Zitieren
APA
Fang, B., Zhao, Y., Han, G., & He, J. (2023). Expression-Guided Deep Joint Learning for Facial Expression Recognition. Sensors, 23(16), 7148. https://doi.org/10.3390/s23167148
Vancouver
Fang B, Zhao Y, Han G, He J. Expression-Guided Deep Joint Learning for Facial Expression Recognition. Sensors. 2023;23(16):7148. doi:10.3390/s23167148
BibTeX
@article{Fang2023,
author = {Fang, Bei and Zhao, Yujie and Han, Guangxin and He, Juhou},
title = {Expression-Guided Deep Joint Learning for Facial Expression Recognition},
journal = {Sensors},
year = {2023},
volume = {23},
number = {16},
pages = {7148},
doi = {10.3390/s23167148}
}
EUVIMED