Rethinking Student Engagement Datasets for AI in Virtual Learning: A Narrative Review
Education Sciences · 01.04.2026 · 16 (4) · 548
DOI: 10.3390/educsci16040548 ↗Kurz gefasst
Fachartikel in der Zeitschrift Education Sciences, online erschienen am 01.04.2026. Verfasst von Shehroz S. Khan und 2 weiteren Autor:innen. Die Arbeit nennt 82 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: University Health Network, University of Toronto Lillian Love Chair in Women’s Health.
Abstract (Originalsprache)
Student engagement (SE) is central to learning success in virtual environments, and artificial intelligence (AI) models increasingly rely on annotated datasets to estimate it automatically. However, existing datasets vary substantially in how engagement is defined and operationalized. This narrative review examined 31 SE datasets collected in computer-based virtual learning settings, analyzing them across seven dimensions of engagement annotation: sources, modality, timing, temporal resolution, level of abstraction, combination, and quantification. Substantial heterogeneity was observed, with only 3 of the 31 datasets explicitly grounding their annotations in psychometrically validated or theoretically established engagement constructs. These inconsistencies have important implications for AI model development. For example, mismatches between the modality used for annotation and that used for model training may reduce robustness, and divergent quantification schemes (binary, ordinal, or continuous) restrict cross-dataset comparability and transferability. By explicitly linking dataset design decisions to risks affecting model validity, generalization, and interpretability, this review highlights the need for stronger construct grounding, clearer reporting of annotation protocols, and greater standardization to support more reliable and transferable engagement-aware AI systems.
Förderung
- University Health Network
- University of Toronto Lillian Love Chair in Women’s Health
Zitieren
APA
Khan, S. S., Abedi, A., & Colella, T. J. F. (2026). Rethinking Student Engagement Datasets for AI in Virtual Learning: A Narrative Review. Education Sciences, 16(4), 548. https://doi.org/10.3390/educsci16040548
Vancouver
Khan SS, Abedi A, Colella TJF. Rethinking Student Engagement Datasets for AI in Virtual Learning: A Narrative Review. Education Sciences. 2026;16(4):548. doi:10.3390/educsci16040548
BibTeX
@article{Khan2026,
author = {Khan, Shehroz S. and Abedi, Ali and Colella, Tracey J. F.},
title = {Rethinking Student Engagement Datasets for AI in Virtual Learning: A Narrative Review},
journal = {Education Sciences},
year = {2026},
volume = {16},
number = {4},
pages = {548},
doi = {10.3390/educsci16040548}
}
EUVIMED