EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

An Explainable Student Fatigue Monitoring Module with Joint Facial Representation

Xiaomian Li, Jiaqin Lin, Zhiqiang Tian iD, Yuping Lin

Sensors · 30.03.2023 · 23 (7) · 3602

DOI: 10.3390/s23073602 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 30.03.2023. Verfasst von Xiaomian Li und 3 weiteren Autor:innen. Beteiligte Einrichtung: School of Foreign Studies, Xi'an Jiaotong University, Xi'an 710049, China. Hauptthemen laut MEDLINE: Students, Academic Performance. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 62 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Social Science Foundation of Shaanxi Province of China, Natural Science Basic Research Plan in Shaanxi Province of China, Social Science Foundation of the Shaanxi Province of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Online fatigue estimation is, inevitably, in demand as fatigue can impair the health of college students and lower the quality of higher education. Therefore, it is essential to monitor college students’ fatigue to diminish its adverse effects on the health and academic performance of college students. However, former studies on student fatigue monitoring are mainly survey-based with offline analysis, instead of using constant fatigue monitoring. Hence, we proposed an explainable student fatigue estimation model based on joint facial representation. This model includes two modules: a spacial–temporal symptom classification module and a data-experience joint status inferring module. The first module tracks a student’s face and generates spatial–temporal features using a deep convolutional neural network (CNN) for the relevant drivers of abnormal symptom classification; the second module infers a student’s status with symptom classification results with maximum a posteriori (MAP) under the data-experience joint constraints. The model was trained on the benchmark NTHU Driver Drowsiness Detection (NTHU-DDD) dataset and tested on an Online Student Fatigue Monitoring (OSFM) dataset. Our method outperformed the other methods with an accuracy rate of 94.47% under the same training–testing setting. The results were significant for real-time monitoring of students’ fatigue states during online classes and could also provide practical strategies for in-person education.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

StudentsAcademic PerformanceHumansBenchmarkingSurveys and Questionnaires

Stichwörter der Autor:innen

CNNMPAjoint facial representationonline fatigue detectionvideo-based online fatigue detection

Autor:innen und Institutionen

  • School of Foreign Studies, Xi'an Jiaotong University, Xi'an 710049, China.
  • Institute of Artificial Intelligence and Robotics, School of Electronic and Information Engineering, Xi'an Jiaotong University, Xi'an 710049, China.
  • School of Software Engineering, Xi'an Jiaotong University, Xi'an 710049, China.

ORCID-Profile: Zhiqiang Tian

Förderung

  • Social Science Foundation of Shaanxi Province of China
  • Natural Science Basic Research Plan in Shaanxi Province of China
  • Social Science Foundation of the Shaanxi Province of China
  • Natural Science Basic Research Plan of the Shaanxi Province of China
  • Shaanxi Province Key Research and Development Program

Zitieren

APA

Li, X., Lin, J., Tian, Z., & Lin, Y. (2023). An Explainable Student Fatigue Monitoring Module with Joint Facial Representation. Sensors, 23(7), 3602. https://doi.org/10.3390/s23073602

Vancouver

Li X, Lin J, Tian Z, Lin Y. An Explainable Student Fatigue Monitoring Module with Joint Facial Representation. Sensors. 2023;23(7):3602. doi:10.3390/s23073602

BibTeX
@article{Li2023,
  author = {Li, Xiaomian and Lin, Jiaqin and Tian, Zhiqiang and Lin, Yuping},
  title = {An Explainable Student Fatigue Monitoring Module with Joint Facial Representation},
  journal = {Sensors},
  year = {2023},
  volume = {23},
  number = {7},
  pages = {3602},
  doi = {10.3390/s23073602}
}
Kostenlos starten →