EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Large-Scale Assessments for Learning: A Human-Centred AI Approach to Contextualizing Test Performance

Hongwen Guo, Matthew Johnson, Kadriye Ercikan, Luis Saldivia, Michelle Worthington

Journal of Learning Analytics · 03.08.2024 · 11 (2) · 229-245

DOI: 10.18608/jla.2024.8007 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Learning Analytics, online erschienen am 03.08.2024. Verfasst von Hongwen Guo und 4 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Large-scale assessments play a key role in education: educators and stakeholders need to know what students know and can do, so that they can be prepared for education policies and interventions in teaching and learning. However, a score from the assessment may not be enough—educators need to know why students got low scores, how students engaged with the tasks and the assessment, and how students with different levels of skills worked through the assessment. Process data, combined with response data, reflect students’ test-taking processes and can provide educators such rich information, but manually labelling the complex data is hard to scale for large-scale assessments. From scratch, we leveraged machine learning techniques (including supervised, unsupervised, and active learning) and experimented with a general human-centred AI approach to help subject matter experts efficiently and effectively make sense of big data (including students’ interaction sequences with the digital assessment platform, such as response, timing, and tool use sequences) to provide process profiles, that is, a holistic view of students’ entire test-taking processes on the assessment, so that performance can be viewed in context. Process profiles may help identify different sources for low performance and help generate rich feedback to educators and policy makers. The released National Assessment of Educational Progress (NAEP) Grade 8 mathematics data were used to illustrate our proposed approach.

Zitieren

APA

Guo, H., Johnson, M., Ercikan, K., Saldivia, L., & Worthington, M. (2024). Large-Scale Assessments for Learning: A Human-Centred AI Approach to Contextualizing Test Performance. Journal of Learning Analytics, 11(2), 229-245. https://doi.org/10.18608/jla.2024.8007

Vancouver

Guo H, Johnson M, Ercikan K, Saldivia L, Worthington M. Large-Scale Assessments for Learning: A Human-Centred AI Approach to Contextualizing Test Performance. Journal of Learning Analytics. 2024;11(2):229-245. doi:10.18608/jla.2024.8007

BibTeX
@article{Guo2024,
  author = {Guo, Hongwen and Johnson, Matthew and Ercikan, Kadriye and Saldivia, Luis and Worthington, Michelle},
  title = {Large-Scale Assessments for Learning: A Human-Centred AI Approach to Contextualizing Test Performance},
  journal = {Journal of Learning Analytics},
  year = {2024},
  volume = {11},
  number = {2},
  pages = {229--245},
  doi = {10.18608/jla.2024.8007}
}
Kostenlos starten →