EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Rethinking Student Engagement Datasets for AI in Virtual Learning: A Narrative Review

Shehroz S. Khan, Ali Abedi, Tracey J. F. Colella

Education Sciences · 01.04.2026 · 16 (4) · 548

DOI: 10.3390/educsci16040548 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Education Sciences, online erschienen am 01.04.2026. Verfasst von Shehroz S. Khan und 2 weiteren Autor:innen. Die Arbeit nennt 82 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: University Health Network, University of Toronto Lillian Love Chair in Women’s Health.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Student engagement (SE) is central to learning success in virtual environments, and artificial intelligence (AI) models increasingly rely on annotated datasets to estimate it automatically. However, existing datasets vary substantially in how engagement is defined and operationalized. This narrative review examined 31 SE datasets collected in computer-based virtual learning settings, analyzing them across seven dimensions of engagement annotation: sources, modality, timing, temporal resolution, level of abstraction, combination, and quantification. Substantial heterogeneity was observed, with only 3 of the 31 datasets explicitly grounding their annotations in psychometrically validated or theoretically established engagement constructs. These inconsistencies have important implications for AI model development. For example, mismatches between the modality used for annotation and that used for model training may reduce robustness, and divergent quantification schemes (binary, ordinal, or continuous) restrict cross-dataset comparability and transferability. By explicitly linking dataset design decisions to risks affecting model validity, generalization, and interpretability, this review highlights the need for stronger construct grounding, clearer reporting of annotation protocols, and greater standardization to support more reliable and transferable engagement-aware AI systems.

Förderung

  • University Health Network
  • University of Toronto Lillian Love Chair in Women’s Health

Zitieren

APA

Khan, S. S., Abedi, A., & Colella, T. J. F. (2026). Rethinking Student Engagement Datasets for AI in Virtual Learning: A Narrative Review. Education Sciences, 16(4), 548. https://doi.org/10.3390/educsci16040548

Vancouver

Khan SS, Abedi A, Colella TJF. Rethinking Student Engagement Datasets for AI in Virtual Learning: A Narrative Review. Education Sciences. 2026;16(4):548. doi:10.3390/educsci16040548

BibTeX
@article{Khan2026,
  author = {Khan, Shehroz S. and Abedi, Ali and Colella, Tracey J. F.},
  title = {Rethinking Student Engagement Datasets for AI in Virtual Learning: A Narrative Review},
  journal = {Education Sciences},
  year = {2026},
  volume = {16},
  number = {4},
  pages = {548},
  doi = {10.3390/educsci16040548}
}
Kostenlos starten →