Optimizing Implementation of Artificial‐Intelligence‐Based Automated Scoring: An Evidence Centered Design Approach for Designing Assessments for AI‐based Scoring
Journal of Educational Measurement · 2022-09 · 59 (3) · 272-287
DOI: 10.1111/jedm.12332 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Educational Measurement, online erschienen am 12.06.2022. Verfasst von Kadriye Ercikan und 1 weiteren Autor:innen. Die Arbeit wurde bisher 43-mal zitiert (Crossref) und nennt 25 Literaturangaben.
Abstract (Originalsprache)
Artificial‐intelligence‐based automated scoring is often an afterthought and is considered after assessments have been developed, resulting in nonoptimal possibility of implementing automated scoring solutions. In this article, we provide a review of Artificial intelligence (AI)‐based methodologies for scoring in educational assessments. We then propose an evidence‐centered design framework for developing assessments to align conceptualization, scoring, and ultimate assessment interpretation and use with the advantages and limitations of AI‐based scoring in mind. We provide recommendations for defining construct, task, and evidence models to guide task and assessment design that optimize the development and implementation of AI‐based automated scoring of constructed response items and support the validity of inferences from and uses of scores.
Zitieren
APA
Ercikan, K., & McCaffrey, D. F. (2022). Optimizing Implementation of Artificial‐Intelligence‐Based Automated Scoring: An Evidence Centered Design Approach for Designing Assessments for AI‐based Scoring. Journal of Educational Measurement, 59(3), 272-287. https://doi.org/10.1111/jedm.12332
Vancouver
Ercikan K, McCaffrey DF. Optimizing Implementation of Artificial‐Intelligence‐Based Automated Scoring: An Evidence Centered Design Approach for Designing Assessments for AI‐based Scoring. Journal of Educational Measurement. 2022;59(3):272-287. doi:10.1111/jedm.12332
BibTeX
@article{Ercikan2022,
author = {Ercikan, Kadriye and McCaffrey, Daniel F.},
title = {Optimizing Implementation of Artificial‐Intelligence‐Based Automated Scoring: An Evidence Centered Design Approach for Designing Assessments for AI‐based Scoring},
journal = {Journal of Educational Measurement},
year = {2022},
volume = {59},
number = {3},
pages = {272--287},
doi = {10.1111/jedm.12332}
}
EUVIMED