Monitoring of Scoring Using the e‐rater ® Automated Scoring System and Human Raters on a Writing Test
ETS Research Report Series · 2014-06 · 2014 (1) · 1-21
DOI: 10.1002/ets2.12005 ↗Kurz gefasst
Fachartikel in der Zeitschrift ETS Research Report Series, online erschienen am 29.04.2014. Verfasst von Zhen Wang und 1 weiteren Autor:innen. Die Arbeit wurde bisher 18-mal zitiert (Crossref) und nennt 41 Literaturangaben.
Abstract (Originalsprache)
This article proposes and investigates several methodologies for monitoring the quality of constructed‐response ( CR ) scoring, both human and automated. There is an increased interest in the operational scoring of essays using both automated scoring and human raters. There is also evidence of rater effects —scoring severity and score inconsistency by human raters. Recently, automated scoring of CRs was successfully implemented with human scoring for operational programs ( TOEFL ® and GRE ® tests); however, there is much that is not yet known about the performance of automated scoring systems. Hence, for quality assurance purposes, there is the need to provide a consistent and standardized approach to monitor the quality of the CR scoring over time and across programs. Monitoring the scoring results will help provide scores that are both fair and accurate for test takers and test users, enabling testing programs to detect and correct changes in the severity of scoring.
Zitieren
APA
Wang, Z., & Davier, A. A. V. (2014). Monitoring of Scoring Using the e‐rater ® Automated Scoring System and Human Raters on a Writing Test. ETS Research Report Series, 2014(1), 1-21. https://doi.org/10.1002/ets2.12005
Vancouver
Wang Z, Davier AAV. Monitoring of Scoring Using the e‐rater ® Automated Scoring System and Human Raters on a Writing Test. ETS Research Report Series. 2014;2014(1):1-21. doi:10.1002/ets2.12005
BibTeX
@article{Wang2014,
author = {Wang, Zhen and Davier, Alina A. von},
title = {Monitoring of Scoring Using the e‐rater ® Automated Scoring System and Human Raters on a Writing Test},
journal = {ETS Research Report Series},
year = {2014},
volume = {2014},
number = {1},
pages = {1--21},
doi = {10.1002/ets2.12005}
}
EUVIMED