Strategic item selection and power in true/false tests: Insights for negative marking
International Journal of Assessment Tools in Education · 26.10.2026 · (Advanced Online Publication) · 1133-1155
DOI: 10.21449/ijate.1888820 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Assessment Tools in Education, online erschienen am 26.10.2026. Verfasst von Niklas Karlsson und 1 weiteren Autor:innen. Die Arbeit nennt 35 Literaturangaben.
Abstract (Originalsprache)
We compare Number-Correct Scoring (NCS) and Negative Marking (NM; +1/−1/0) for pass–fail decisions in short true/false tests. Using a framework that models optimal responding under NM and distinguishes between examinees' true and perceived success probabilities, we evaluate statistical power across heterogeneous distributions of item success probabilities. NM yields higher power when difficulties vary substantially and examinees are at least roughly well-calibrated, while NCS is more robust when miscalibration takes the form of systematic additive shifts in perceived probabilities, including both underconfidence and the more detrimental case of overconfidence for NM. Notably, overconfidence under NM can lead to overly selective rather than excessively risky responding, as examinees may omit items that would increase their true probability of passing. The results provide a decision-theoretic comparison of NCS and NM, showing how scoring-rule performance depends jointly on the scoring rule and the answering strategy implied by examinees’ perceived probabilities. Findings further inform the choice of scoring rules in educational assessments by identifying conditions under which their relative performance differs.
Zitieren
APA
Karlsson, N., & Lunander, A. (2026). Strategic item selection and power in true/false tests: Insights for negative marking. International Journal of Assessment Tools in Education, 1133-1155. https://doi.org/10.21449/ijate.1888820
Vancouver
Karlsson N, Lunander A. Strategic item selection and power in true/false tests: Insights for negative marking. International Journal of Assessment Tools in Education. 2026:1133-1155. doi:10.21449/ijate.1888820
BibTeX
@article{Karlsson2026,
author = {Karlsson, Niklas and Lunander, Anders},
title = {Strategic item selection and power in true/false tests: Insights for negative marking},
journal = {International Journal of Assessment Tools in Education},
year = {2026},
number = {Advanced Online Publication},
pages = {1133--1155},
doi = {10.21449/ijate.1888820}
}
EUVIMED