A Cost–Benefit Analysis of Automatic Item Generation
Educational Measurement: Issues and Practice · 2019-03 · 38 (1) · 48-53
DOI: 10.1111/emip.12237 ↗Kurz gefasst
Fachartikel in der Zeitschrift Educational Measurement: Issues and Practice, online erschienen am 27.12.2018. Verfasst von Audra E. Kosh und 4 weiteren Autor:innen. Die Arbeit wurde bisher 30-mal zitiert (Crossref) und nennt 20 Literaturangaben.
Abstract (Originalsprache)
Automatic item generation (AIG)—a means of leveraging technology to create large quantities of items—requires a minimum number of items to offset the sizable upfront investment (i.e., model development and technology deployment) in order to achieve cost savings. In this cost–benefit analysis, we estimated the cost of each step of AIG and manual item writing and applied cost—benefit formulas to calculate the number of items that would have to be produced before the upfront costs of AIG outweigh manual item writing costs in the context of K‐12 mathematics items. Results indicated that AIG is more cost‐effective than manual item writing when developing, at a minimum, 173 to 247 items within one fine‐grained content area (e.g., fourth‐ through seventh‐grade area of figures). The article concludes with a discussion of implications for test developers and the nonmonetary tradeoffs involved in AIG.
Zitieren
APA
Kosh, A. E., Simpson, M. A., Bickel, L., Kellogg, M., & Sanford‐Moore, E. (2019). A Cost–Benefit Analysis of Automatic Item Generation. Educational Measurement: Issues and Practice, 38(1), 48-53. https://doi.org/10.1111/emip.12237
Vancouver
Kosh AE, Simpson MA, Bickel L, Kellogg M, Sanford‐Moore E. A Cost–Benefit Analysis of Automatic Item Generation. Educational Measurement: Issues and Practice. 2019;38(1):48-53. doi:10.1111/emip.12237
BibTeX
@article{Kosh2019,
author = {Kosh, Audra E. and Simpson, Mary Ann and Bickel, Lisa and Kellogg, Mark and Sanford‐Moore, Ellie},
title = {A Cost–Benefit Analysis of Automatic Item Generation},
journal = {Educational Measurement: Issues and Practice},
year = {2019},
volume = {38},
number = {1},
pages = {48--53},
doi = {10.1111/emip.12237}
}
EUVIMED