Design and analysis of teaching early warning system based on multimodal data in an intelligent learning environment
PeerJ Computer Science · 04.03.2025 · 11 · e2692
DOI: 10.7717/peerj-cs.2692 ↗Kurz gefasst
Fachartikel in der Zeitschrift PeerJ Computer Science, online erschienen am 04.03.2025. Verfasst von Xinxin Kang und 1 weiteren Autor:innen. Beteiligte Einrichtung: School of Education, Shaanxi Normal University, Xi'an, Shaanxi, China. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 18 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
In online teaching environments, the lack of direct emotional interaction between teachers and students poses challenges for teachers to consciously and effectively manage their emotional expressions. The design and implementation of an early warning system for teaching provide a novel approach to intelligent evaluation and improvement of online education. This study focuses on segmenting different emotional segments and recognizing emotions in instructional videos. An efficient long-video emotional transition point search algorithm is proposed for segmenting video emotional segments. Leveraging the fact that teachers tend to maintain a neutral emotional state for significant portions of their teaching, a neutral emotional segment filtering algorithm based on facial features has been designed. A multimodal emotional recognition model is proposed for emotional recognition in instructional videos. It begins with preprocessing the raw speech and facial image features, employing a semi-supervised iterative feature normalization algorithm to eliminate individual teacher differences while preserving inherent differences between different emotions. A deep learning-based multimodal emotional recognition model for teacher instructional videos is introduced, incorporating an attention mechanism to automatically assign weights for feature-level modal fusion, providing users with accurate emotional classification. Finally, a teaching early warning system is implemented based on these algorithms.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Education, Shaanxi Normal University, Xi'an, Shaanxi, China.
- Informatization Office, Xi'an Conservatory of Music, Xi'an, Shaanxi, China.
ORCID-Profile: Xinxin Kang
Zitieren
APA
Kang, X., & Nie, Y. (2025). Design and analysis of teaching early warning system based on multimodal data in an intelligent learning environment. PeerJ Computer Science, 11, e2692. https://doi.org/10.7717/peerj-cs.2692
Vancouver
Kang X, Nie Y. Design and analysis of teaching early warning system based on multimodal data in an intelligent learning environment. PeerJ Computer Science. 2025;11:e2692. doi:10.7717/peerj-cs.2692
BibTeX
@article{Kang2025,
author = {Kang, Xinxin and Nie, Yong},
title = {Design and analysis of teaching early warning system based on multimodal data in an intelligent learning environment},
journal = {PeerJ Computer Science},
year = {2025},
volume = {11},
pages = {e2692},
doi = {10.7717/peerj-cs.2692}
}
EUVIMED