A Student Facial Expression Recognition Model Based on Multi-Scale and Deep Fine-Grained Feature Attention Enhancement
Sensors · 20.10.2024 · 24 (20) · 6748
DOI: 10.3390/s24206748 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 20.10.2024. Verfasst von Zhaoyu Shou und 6 weiteren Autor:innen. Beteiligte Einrichtung: School of Information and Communication, Guilin University of Electronic Technology, Guilin 541004, China. Hauptthemen laut MEDLINE: Facial Expression, Students. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Guangxi Natural Science Foundation under Grant, The Project of Guangxi Wireless Broadband Communication and Signal Processing Key Laboratory.
Abstract (Originalsprache)
In smart classroom environments, accurately recognizing students’ facial expressions is crucial for teachers to efficiently assess students’ learning states, timely adjust teaching strategies, and enhance teaching quality and effectiveness. In this paper, we propose a student facial expression recognition model based on multi-scale and deep fine-grained feature attention enhancement (SFER-MDFAE) to address the issues of inaccurate facial feature extraction and poor robustness of facial expression recognition in smart classroom scenarios. Firstly, we construct a novel multi-scale dual-pooling feature aggregation module to capture and fuse facial information at different scales, thereby obtaining a comprehensive representation of key facial features; secondly, we design a key region-oriented attention mechanism to focus more on the nuances of facial expressions, further enhancing the representation of multi-scale deep fine-grained feature; finally, the fusion of multi-scale and deep fine-grained attention-enhanced features is used to obtain richer and more accurate facial key information and realize accurate facial expression recognition. The experimental results demonstrate that the proposed SFER-MDFAE outperforms the existing state-of-the-art methods, achieving an accuracy of 76.18% on FER2013, 92.75% on FERPlus, 92.93% on RAF-DB, 67.86% on AffectNet, and 93.74% on the real smart classroom facial expression dataset (SCFED). These results validate the effectiveness of the proposed method.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Information and Communication, Guilin University of Electronic Technology, Guilin 541004, China.
- Guangxi Wireless Broadband Communication and Signal Processing Key Laboratory, Guilin University of Electronic Technology, Guilin 541004, China.
- School of Computer and Information Security, Guilin University of Electronic Technology, Guilin 541004, China.
- 34th Research Institute of China Electronics Technology Group Corporation, Guilin 541004, China.
ORCID-Profile: Zhaoyu Shou
Förderung
- National Natural Science Foundation of China
- Guangxi Natural Science Foundation under Grant
- The Project of Guangxi Wireless Broadband Communication and Signal Processing Key Laboratory
- Innovation Project of Guangxi Graduate Education
- Guangxi Natural Science Foundation
- Project of Guangxi Wireless Broadband Communication and Signal Processing Key Laboratory
Zitieren
APA
Shou, Z., Huang, Y., Li, D., Feng, C., Zhang, H., Lin, Y., & Wu, G. (2024). A Student Facial Expression Recognition Model Based on Multi-Scale and Deep Fine-Grained Feature Attention Enhancement. Sensors, 24(20), 6748. https://doi.org/10.3390/s24206748
Vancouver
Shou Z, Huang Y, Li D, Feng C, Zhang H, Lin Y, et al. A Student Facial Expression Recognition Model Based on Multi-Scale and Deep Fine-Grained Feature Attention Enhancement. Sensors. 2024;24(20):6748. doi:10.3390/s24206748
BibTeX
@article{Shou2024,
author = {Shou, Zhaoyu and Huang, Yi and Li, Dongxu and Feng, Cheng and Zhang, Huibing and Lin, Yuming and Wu, Guangxiang},
title = {A Student Facial Expression Recognition Model Based on Multi-Scale and Deep Fine-Grained Feature Attention Enhancement},
journal = {Sensors},
year = {2024},
volume = {24},
number = {20},
pages = {6748},
doi = {10.3390/s24206748}
}
EUVIMED