EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Optimizing calibration designs with uncertainty in abilities

Jonas Bjermo iD, Ellinor Fackle-Fornius, Frank Miller

British Journal of Mathematical and Statistical Psychology · 2025

DOI: 10.1111/bmsp.12387 ↗

Kurz gefasst

Fachartikel in der Zeitschrift British Journal of Mathematical and Statistical Psychology, 2025. Verfasst von Jonas Bjermo und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Computer and Information Science, Linköping University, Linköping, Sweden. Hauptthemen laut MEDLINE: Psychometrics, Research Design, Educational Measurement. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 42 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Swedish Research Council (Vetenskapsrådet), Vetenskapsrådet.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Before items can be implemented in a test, the item characteristics need to be calibrated through pretesting. To achieve high‐quality tests, it's crucial to maximize the precision of estimates obtained during item calibration. Higher precision can be attained if calibration items are allocated to examinees based on their individual abilities. Methods from optimal experimental design can be used to derive an optimal ability‐matched calibration design. However, such an optimal design assumes known abilities of the examinees. In practice, the abilities are unknown and estimated based on a limited number of operational items. We develop the theory for handling the uncertainty in abilities in a proper way and show how the optimal calibration design can be derived when taking account of this uncertainty. We demonstrate that the derived designs are more robust when the uncertainty in abilities is acknowledged. Additionally, the method has been implemented in the R‐package optical .

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

PsychometricsResearch DesignEducational MeasurementUncertaintyCalibrationHumansModels, StatisticalReproducibility of Results

Stichwörter der Autor:innen

abilitycomputerized adaptive testsitem calibrationoptimal experimental design

Autor:innen und Institutionen

  • Department of Computer and Information Science, Linköping University, Linköping, Sweden.
  • Department of Statistics, Stockholm University, Stockholm, Sweden.

ORCID-Profile: Jonas Bjermo

Förderung

  • Swedish Research Council (Vetenskapsrådet)
  • Vetenskapsrådet

Zitieren

APA

Bjermo, J., Fackle-Fornius, E., & Miller, F. (2025). Optimizing calibration designs with uncertainty in abilities. British Journal of Mathematical and Statistical Psychology. https://doi.org/10.1111/bmsp.12387

Vancouver

Bjermo J, Fackle-Fornius E, Miller F. Optimizing calibration designs with uncertainty in abilities. British Journal of Mathematical and Statistical Psychology. 2025. doi:10.1111/bmsp.12387

BibTeX
@article{Bjermo2025,
  author = {Bjermo, Jonas and Fackle-Fornius, Ellinor and Miller, Frank},
  title = {Optimizing calibration designs with uncertainty in abilities},
  journal = {British Journal of Mathematical and Statistical Psychology},
  year = {2025},
  doi = {10.1111/bmsp.12387}
}
Kostenlos starten →