EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A multidimensional generalized many-facet Rasch model for rubric-based performance assessment

Masaki Uto

Behaviormetrika · 2021-07 · 48 (2) · 425-457

DOI: 10.1007/s41237-021-00144-w ↗

Kurz gefasst

Fachartikel in der Zeitschrift Behaviormetrika, online erschienen am 30.07.2021. Verfasst von Masaki Uto. Die Arbeit wurde bisher 25-mal zitiert (Crossref) und nennt 74 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Japan Society for the Promotion of Science.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Performance assessment, in which human raters assess examinee performance in a practical task, often involves the use of a scoring rubric consisting of multiple evaluation items to increase the objectivity of evaluation. However, even when using a rubric, assigned scores are known to depend on characteristics of the rubric’s evaluation items and the raters, thus decreasing ability measurement accuracy. To resolve this problem, item response theory (IRT) models that can estimate examinee ability while considering the effects of these characteristics have been proposed. These IRT models assume unidimensionality, meaning that a rubric measures one latent ability. In practice, however, this assumption might not be satisfied because a rubric’s evaluation items are often designed to measure multiple sub-abilities that constitute a targeted ability. To address this issue, this study proposes a multidimensional IRT model for rubric-based performance assessment. Specifically, the proposed model is formulated as a multidimensional extension of a generalized many-facet Rasch model. Moreover, a No-U-Turn variant of the Hamiltonian Markov chain Monte Carlo algorithm is adopted as a parameter estimation method for the proposed model. The proposed model is useful not only for improving the ability measurement accuracy, but also for detailed analysis of rubric quality and rubric construct validity. The study demonstrates the effectiveness of the proposed model through simulation experiments and application to real data.

Förderung

  • Japan Society for the Promotion of Science

Zitieren

APA

Uto, M. (2021). A multidimensional generalized many-facet Rasch model for rubric-based performance assessment. Behaviormetrika, 48(2), 425-457. https://doi.org/10.1007/s41237-021-00144-w

Vancouver

Uto M. A multidimensional generalized many-facet Rasch model for rubric-based performance assessment. Behaviormetrika. 2021;48(2):425-457. doi:10.1007/s41237-021-00144-w

BibTeX
@article{Uto2021,
  author = {Uto, Masaki},
  title = {A multidimensional generalized many-facet Rasch model for rubric-based performance assessment},
  journal = {Behaviormetrika},
  year = {2021},
  volume = {48},
  number = {2},
  pages = {425--457},
  doi = {10.1007/s41237-021-00144-w}
}
Kostenlos starten →