EUVIMEDEUVIMED entdecken
Crossref

Empirical option weights for multiple-choice items

Gregor Sočan

Advances in Methodology and Statistics · 2015

DOI: 10.51936/bfrh1091 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Advances in Methodology and Statistics, 2015. Verfasst von Gregor Sočan.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In scoring of a multiple-choice test, the number of correct answers does not use all information available from item responses. Scoring such tests by applying empirically determined weights to the chosen options should provide more information on examinees' knowledge and consequently produce more valid test scores. However, existing empirical evidence on this topic does not clearly support option weighting. To overcome the limitations of the previous studies, we performed a simulation study where we manipulated the instruction to examinees, discrimination structure of distractors, test length, and sample size. We compared validity and internal consistency of number-correct scores, corrected-for-guessing scores, two variants of correlation-weighted scores and homogeneity analysis scores. The results suggest that in certain conditions the correlation-weighted scores are notably more valid than the number-correct scores. On the other hand, homogeneity analysis cannot be recommended as a scoring method. The relative performance of scoring methods strongly depends on the instructions and on distractors' properties, and only to a lesser extent on sample size and test length.

Zitieren

APA

Sočan, G. (2015). Empirical option weights for multiple-choice items. Advances in Methodology and Statistics. https://doi.org/10.51936/bfrh1091

Vancouver

Sočan G. Empirical option weights for multiple-choice items. Advances in Methodology and Statistics. 2015. doi:10.51936/bfrh1091

BibTeX
@article{Soan2015,
  author = {Sočan, Gregor},
  title = {Empirical option weights for multiple-choice items},
  journal = {Advances in Methodology and Statistics},
  year = {2015},
  doi = {10.51936/bfrh1091}
}
Kostenlos starten →