An Explainable Student Fatigue Monitoring Module with Joint Facial Representation
Sensors · 30.03.2023 · 23 (7) · 3602
DOI: 10.3390/s23073602 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 30.03.2023. Verfasst von Xiaomian Li und 3 weiteren Autor:innen. Beteiligte Einrichtung: School of Foreign Studies, Xi'an Jiaotong University, Xi'an 710049, China. Hauptthemen laut MEDLINE: Students, Academic Performance. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 62 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Social Science Foundation of Shaanxi Province of China, Natural Science Basic Research Plan in Shaanxi Province of China, Social Science Foundation of the Shaanxi Province of China.
Abstract (Originalsprache)
Online fatigue estimation is, inevitably, in demand as fatigue can impair the health of college students and lower the quality of higher education. Therefore, it is essential to monitor college students’ fatigue to diminish its adverse effects on the health and academic performance of college students. However, former studies on student fatigue monitoring are mainly survey-based with offline analysis, instead of using constant fatigue monitoring. Hence, we proposed an explainable student fatigue estimation model based on joint facial representation. This model includes two modules: a spacial–temporal symptom classification module and a data-experience joint status inferring module. The first module tracks a student’s face and generates spatial–temporal features using a deep convolutional neural network (CNN) for the relevant drivers of abnormal symptom classification; the second module infers a student’s status with symptom classification results with maximum a posteriori (MAP) under the data-experience joint constraints. The model was trained on the benchmark NTHU Driver Drowsiness Detection (NTHU-DDD) dataset and tested on an Online Student Fatigue Monitoring (OSFM) dataset. Our method outperformed the other methods with an accuracy rate of 94.47% under the same training–testing setting. The results were significant for real-time monitoring of students’ fatigue states during online classes and could also provide practical strategies for in-person education.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Foreign Studies, Xi'an Jiaotong University, Xi'an 710049, China.
- Institute of Artificial Intelligence and Robotics, School of Electronic and Information Engineering, Xi'an Jiaotong University, Xi'an 710049, China.
- School of Software Engineering, Xi'an Jiaotong University, Xi'an 710049, China.
ORCID-Profile: Zhiqiang Tian
Förderung
- Social Science Foundation of Shaanxi Province of China
- Natural Science Basic Research Plan in Shaanxi Province of China
- Social Science Foundation of the Shaanxi Province of China
- Natural Science Basic Research Plan of the Shaanxi Province of China
- Shaanxi Province Key Research and Development Program
Zitieren
APA
Li, X., Lin, J., Tian, Z., & Lin, Y. (2023). An Explainable Student Fatigue Monitoring Module with Joint Facial Representation. Sensors, 23(7), 3602. https://doi.org/10.3390/s23073602
Vancouver
Li X, Lin J, Tian Z, Lin Y. An Explainable Student Fatigue Monitoring Module with Joint Facial Representation. Sensors. 2023;23(7):3602. doi:10.3390/s23073602
BibTeX
@article{Li2023,
author = {Li, Xiaomian and Lin, Jiaqin and Tian, Zhiqiang and Lin, Yuping},
title = {An Explainable Student Fatigue Monitoring Module with Joint Facial Representation},
journal = {Sensors},
year = {2023},
volume = {23},
number = {7},
pages = {3602},
doi = {10.3390/s23073602}
}
EUVIMED