EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Efficient student behavior detection in classroom videos using a keyframe aware multitask transformer

V. Vinothina, Eiko Takaoka, Augustine George, J. Vennila

Discover Artificial Intelligence · 07.08.2026 · 6 (1)

DOI: 10.1007/s44163-026-01906-9 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Discover Artificial Intelligence, online erschienen am 07.08.2026. Verfasst von V. Vinothina und 3 weiteren Autor:innen. Die Arbeit nennt 50 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Manipal Academy of Higher Education, Manipal.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Student Behavior detection in classroom videos has significant benefits for maintaining classroom discipline, monitoring students’ reactions, and evaluating teaching methods. Recent developments in deep learning techniques have enabled robust automated systems across diverse domains. However, despite the widespread adoption of these techniques in industrial application, automated classroom student behavior detection remains an evolving research area in terms of computational efficiency and an effective temporal modeling. Hence, this study attempts to design a transformer-based model with a lightweight, learnable keyframe selection module that learns to globally rank and select the top-K frames per video sequence in an end-to-end manner using downstream classification objectives. For better semantic representations of video clips, the CLIP model was employed, and a customized transformer model with two classification heads was used for behavior prediction and anomaly classification. The model was assessed with spatial- and spatiotemporal-based models on the EduNet dataset, and an ablation experiment illustrated the impact of the keyframe selection module. The proposed model achieves 91% accuracy in behavior detection, demonstrating performance comparable to existing methods while maintaining improved computational efficiency. The proposed system contributes to the education domain by maintaining classroom ecology.

Förderung

  • Manipal Academy of Higher Education, Manipal

Zitieren

APA

Vinothina, V., Takaoka, E., George, A., & Vennila, J. (2026). Efficient student behavior detection in classroom videos using a keyframe aware multitask transformer. Discover Artificial Intelligence, 6(1). https://doi.org/10.1007/s44163-026-01906-9

Vancouver

Vinothina V, Takaoka E, George A, Vennila J. Efficient student behavior detection in classroom videos using a keyframe aware multitask transformer. Discover Artificial Intelligence. 2026;6(1). doi:10.1007/s44163-026-01906-9

BibTeX
@article{Vinothina2026,
  author = {Vinothina, V. and Takaoka, Eiko and George, Augustine and Vennila, J.},
  title = {Efficient student behavior detection in classroom videos using a keyframe aware multitask transformer},
  journal = {Discover Artificial Intelligence},
  year = {2026},
  volume = {6},
  number = {1},
  doi = {10.1007/s44163-026-01906-9}
}
Kostenlos starten →