Optimizing calibration designs with uncertainty in abilities
British Journal of Mathematical and Statistical Psychology · 2025
DOI: 10.1111/bmsp.12387 ↗Kurz gefasst
Fachartikel in der Zeitschrift British Journal of Mathematical and Statistical Psychology, 2025. Verfasst von Jonas Bjermo und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Computer and Information Science, Linköping University, Linköping, Sweden. Hauptthemen laut MEDLINE: Psychometrics, Research Design, Educational Measurement. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 42 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Swedish Research Council (Vetenskapsrådet), Vetenskapsrådet.
Abstract (Originalsprache)
Before items can be implemented in a test, the item characteristics need to be calibrated through pretesting. To achieve high‐quality tests, it's crucial to maximize the precision of estimates obtained during item calibration. Higher precision can be attained if calibration items are allocated to examinees based on their individual abilities. Methods from optimal experimental design can be used to derive an optimal ability‐matched calibration design. However, such an optimal design assumes known abilities of the examinees. In practice, the abilities are unknown and estimated based on a limited number of operational items. We develop the theory for handling the uncertainty in abilities in a proper way and show how the optimal calibration design can be derived when taking account of this uncertainty. We demonstrate that the derived designs are more robust when the uncertainty in abilities is acknowledged. Additionally, the method has been implemented in the R‐package optical .
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Computer and Information Science, Linköping University, Linköping, Sweden.
- Department of Statistics, Stockholm University, Stockholm, Sweden.
ORCID-Profile: Jonas Bjermo
Förderung
- Swedish Research Council (Vetenskapsrådet)
- Vetenskapsrådet
Zitieren
APA
Bjermo, J., Fackle-Fornius, E., & Miller, F. (2025). Optimizing calibration designs with uncertainty in abilities. British Journal of Mathematical and Statistical Psychology. https://doi.org/10.1111/bmsp.12387
Vancouver
Bjermo J, Fackle-Fornius E, Miller F. Optimizing calibration designs with uncertainty in abilities. British Journal of Mathematical and Statistical Psychology. 2025. doi:10.1111/bmsp.12387
BibTeX
@article{Bjermo2025,
author = {Bjermo, Jonas and Fackle-Fornius, Ellinor and Miller, Frank},
title = {Optimizing calibration designs with uncertainty in abilities},
journal = {British Journal of Mathematical and Statistical Psychology},
year = {2025},
doi = {10.1111/bmsp.12387}
}
EUVIMED