EUVIMEDEUVIMED entdecken
Crossref

Scoring Stability in a Large‐Scale Assessment Program: A Longitudinal Analysis of Leniency/Severity Effects

Corey Palermo, Michael B. Bunch, Kirk Ridge

Journal of Educational Measurement · 2019-09 · 56 (3) · 626-652

DOI: 10.1111/jedm.12228 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Educational Measurement, online erschienen am 05.08.2019. Verfasst von Corey Palermo und 2 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 34 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Although much attention has been given to rater effects in rater‐mediated assessment contexts, little research has examined the overall stability of leniency and severity effects over time. This study examined longitudinal scoring data collected during three consecutive administrations of a large‐scale, multi‐state summative assessment program. Multilevel models were used to assess the overall extent of rater leniency/severity during scoring and examine the extent to which leniency/severity effects were stable across the three administrations. Model results were then applied to scaled scores to estimate the impact of the stability of leniency/severity effects on students’ scores. Results showed relative scoring stability across administrations in mathematics. In English language arts, short constructed response items showed evidence of slightly increasing severity across administrations, while essays showed mixed results: evidence of both slightly increasing severity and moderately increasing leniency over time, depending on trait. However, when model results were applied to scaled scores, results revealed rater effects had minimal impact on students’ scores.

Zitieren

APA

Palermo, C., Bunch, M. B., & Ridge, K. (2019). Scoring Stability in a Large‐Scale Assessment Program: A Longitudinal Analysis of Leniency/Severity Effects. Journal of Educational Measurement, 56(3), 626-652. https://doi.org/10.1111/jedm.12228

Vancouver

Palermo C, Bunch MB, Ridge K. Scoring Stability in a Large‐Scale Assessment Program: A Longitudinal Analysis of Leniency/Severity Effects. Journal of Educational Measurement. 2019;56(3):626-652. doi:10.1111/jedm.12228

BibTeX
@article{Palermo2019,
  author = {Palermo, Corey and Bunch, Michael B. and Ridge, Kirk},
  title = {Scoring Stability in a Large‐Scale Assessment Program: A Longitudinal Analysis of Leniency/Severity Effects},
  journal = {Journal of Educational Measurement},
  year = {2019},
  volume = {56},
  number = {3},
  pages = {626--652},
  doi = {10.1111/jedm.12228}
}
Kostenlos starten →