EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Student Facial Expression Recognition Model Based on Multi-Scale and Deep Fine-Grained Feature Attention Enhancement

Zhaoyu Shou iD, Yi Huang, Dongxu Li, Cheng Feng, Huibing Zhang, Yuming Lin, Guangxiang Wu

Sensors · 20.10.2024 · 24 (20) · 6748

DOI: 10.3390/s24206748 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 20.10.2024. Verfasst von Zhaoyu Shou und 6 weiteren Autor:innen. Beteiligte Einrichtung: School of Information and Communication, Guilin University of Electronic Technology, Guilin 541004, China. Hauptthemen laut MEDLINE: Facial Expression, Students. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Guangxi Natural Science Foundation under Grant, The Project of Guangxi Wireless Broadband Communication and Signal Processing Key Laboratory.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In smart classroom environments, accurately recognizing students’ facial expressions is crucial for teachers to efficiently assess students’ learning states, timely adjust teaching strategies, and enhance teaching quality and effectiveness. In this paper, we propose a student facial expression recognition model based on multi-scale and deep fine-grained feature attention enhancement (SFER-MDFAE) to address the issues of inaccurate facial feature extraction and poor robustness of facial expression recognition in smart classroom scenarios. Firstly, we construct a novel multi-scale dual-pooling feature aggregation module to capture and fuse facial information at different scales, thereby obtaining a comprehensive representation of key facial features; secondly, we design a key region-oriented attention mechanism to focus more on the nuances of facial expressions, further enhancing the representation of multi-scale deep fine-grained feature; finally, the fusion of multi-scale and deep fine-grained attention-enhanced features is used to obtain richer and more accurate facial key information and realize accurate facial expression recognition. The experimental results demonstrate that the proposed SFER-MDFAE outperforms the existing state-of-the-art methods, achieving an accuracy of 76.18% on FER2013, 92.75% on FERPlus, 92.93% on RAF-DB, 67.86% on AffectNet, and 93.74% on the real smart classroom facial expression dataset (SCFED). These results validate the effectiveness of the proposed method.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Facial ExpressionStudentsHumansAlgorithmsAttentionAutomated Facial RecognitionPattern Recognition, Automated

Stichwörter der Autor:innen

deep fine-grained featuresfacial expression recognitionkey region-oriented attention mechanismmulti-scale featuressmart classroom

Autor:innen und Institutionen

  • School of Information and Communication, Guilin University of Electronic Technology, Guilin 541004, China.
  • Guangxi Wireless Broadband Communication and Signal Processing Key Laboratory, Guilin University of Electronic Technology, Guilin 541004, China.
  • School of Computer and Information Security, Guilin University of Electronic Technology, Guilin 541004, China.
  • 34th Research Institute of China Electronics Technology Group Corporation, Guilin 541004, China.

ORCID-Profile: Zhaoyu Shou

Förderung

  • National Natural Science Foundation of China
  • Guangxi Natural Science Foundation under Grant
  • The Project of Guangxi Wireless Broadband Communication and Signal Processing Key Laboratory
  • Innovation Project of Guangxi Graduate Education
  • Guangxi Natural Science Foundation
  • Project of Guangxi Wireless Broadband Communication and Signal Processing Key Laboratory

Zitieren

APA

Shou, Z., Huang, Y., Li, D., Feng, C., Zhang, H., Lin, Y., & Wu, G. (2024). A Student Facial Expression Recognition Model Based on Multi-Scale and Deep Fine-Grained Feature Attention Enhancement. Sensors, 24(20), 6748. https://doi.org/10.3390/s24206748

Vancouver

Shou Z, Huang Y, Li D, Feng C, Zhang H, Lin Y, et al. A Student Facial Expression Recognition Model Based on Multi-Scale and Deep Fine-Grained Feature Attention Enhancement. Sensors. 2024;24(20):6748. doi:10.3390/s24206748

BibTeX
@article{Shou2024,
  author = {Shou, Zhaoyu and Huang, Yi and Li, Dongxu and Feng, Cheng and Zhang, Huibing and Lin, Yuming and Wu, Guangxiang},
  title = {A Student Facial Expression Recognition Model Based on Multi-Scale and Deep Fine-Grained Feature Attention Enhancement},
  journal = {Sensors},
  year = {2024},
  volume = {24},
  number = {20},
  pages = {6748},
  doi = {10.3390/s24206748}
}
Kostenlos starten →