Efficient student behavior detection in classroom videos using a keyframe aware multitask transformer
Discover Artificial Intelligence · 07.08.2026 · 6 (1)
DOI: 10.1007/s44163-026-01906-9 ↗Kurz gefasst
Fachartikel in der Zeitschrift Discover Artificial Intelligence, online erschienen am 07.08.2026. Verfasst von V. Vinothina und 3 weiteren Autor:innen. Die Arbeit nennt 50 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Manipal Academy of Higher Education, Manipal.
Abstract (Originalsprache)
Student Behavior detection in classroom videos has significant benefits for maintaining classroom discipline, monitoring students’ reactions, and evaluating teaching methods. Recent developments in deep learning techniques have enabled robust automated systems across diverse domains. However, despite the widespread adoption of these techniques in industrial application, automated classroom student behavior detection remains an evolving research area in terms of computational efficiency and an effective temporal modeling. Hence, this study attempts to design a transformer-based model with a lightweight, learnable keyframe selection module that learns to globally rank and select the top-K frames per video sequence in an end-to-end manner using downstream classification objectives. For better semantic representations of video clips, the CLIP model was employed, and a customized transformer model with two classification heads was used for behavior prediction and anomaly classification. The model was assessed with spatial- and spatiotemporal-based models on the EduNet dataset, and an ablation experiment illustrated the impact of the keyframe selection module. The proposed model achieves 91% accuracy in behavior detection, demonstrating performance comparable to existing methods while maintaining improved computational efficiency. The proposed system contributes to the education domain by maintaining classroom ecology.
Förderung
- Manipal Academy of Higher Education, Manipal
Zitieren
APA
Vinothina, V., Takaoka, E., George, A., & Vennila, J. (2026). Efficient student behavior detection in classroom videos using a keyframe aware multitask transformer. Discover Artificial Intelligence, 6(1). https://doi.org/10.1007/s44163-026-01906-9
Vancouver
Vinothina V, Takaoka E, George A, Vennila J. Efficient student behavior detection in classroom videos using a keyframe aware multitask transformer. Discover Artificial Intelligence. 2026;6(1). doi:10.1007/s44163-026-01906-9
BibTeX
@article{Vinothina2026,
author = {Vinothina, V. and Takaoka, Eiko and George, Augustine and Vennila, J.},
title = {Efficient student behavior detection in classroom videos using a keyframe aware multitask transformer},
journal = {Discover Artificial Intelligence},
year = {2026},
volume = {6},
number = {1},
doi = {10.1007/s44163-026-01906-9}
}
EUVIMED