Large-Scale Assessments for Learning: A Human-Centred AI Approach to Contextualizing Test Performance
Journal of Learning Analytics · 03.08.2024 · 11 (2) · 229-245
DOI: 10.18608/jla.2024.8007 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Learning Analytics, online erschienen am 03.08.2024. Verfasst von Hongwen Guo und 4 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).
Abstract (Originalsprache)
Large-scale assessments play a key role in education: educators and stakeholders need to know what students know and can do, so that they can be prepared for education policies and interventions in teaching and learning. However, a score from the assessment may not be enough—educators need to know why students got low scores, how students engaged with the tasks and the assessment, and how students with different levels of skills worked through the assessment. Process data, combined with response data, reflect students’ test-taking processes and can provide educators such rich information, but manually labelling the complex data is hard to scale for large-scale assessments. From scratch, we leveraged machine learning techniques (including supervised, unsupervised, and active learning) and experimented with a general human-centred AI approach to help subject matter experts efficiently and effectively make sense of big data (including students’ interaction sequences with the digital assessment platform, such as response, timing, and tool use sequences) to provide process profiles, that is, a holistic view of students’ entire test-taking processes on the assessment, so that performance can be viewed in context. Process profiles may help identify different sources for low performance and help generate rich feedback to educators and policy makers. The released National Assessment of Educational Progress (NAEP) Grade 8 mathematics data were used to illustrate our proposed approach.
Zitieren
APA
Guo, H., Johnson, M., Ercikan, K., Saldivia, L., & Worthington, M. (2024). Large-Scale Assessments for Learning: A Human-Centred AI Approach to Contextualizing Test Performance. Journal of Learning Analytics, 11(2), 229-245. https://doi.org/10.18608/jla.2024.8007
Vancouver
Guo H, Johnson M, Ercikan K, Saldivia L, Worthington M. Large-Scale Assessments for Learning: A Human-Centred AI Approach to Contextualizing Test Performance. Journal of Learning Analytics. 2024;11(2):229-245. doi:10.18608/jla.2024.8007
BibTeX
@article{Guo2024,
author = {Guo, Hongwen and Johnson, Matthew and Ercikan, Kadriye and Saldivia, Luis and Worthington, Michelle},
title = {Large-Scale Assessments for Learning: A Human-Centred AI Approach to Contextualizing Test Performance},
journal = {Journal of Learning Analytics},
year = {2024},
volume = {11},
number = {2},
pages = {229--245},
doi = {10.18608/jla.2024.8007}
}
EUVIMED