Enhancing the defensibility of cut scores: A multi-source evaluation of a modified Angoff standard-setting process in a high-stakes medical examination
GMS Journal for Medical Education · 16.11.2026 · 43 (7)
DOI: 10.3205/zma001889 ↗Kurz gefasst
Fachartikel in der Zeitschrift GMS Journal for Medical Education, erschienen am 16.11.2026. Verfasst von Amare und 15 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Introduction
Standard setting is essential in health professions education, yet establishing credible and defensible cut-off scores remains challenging, particularly when post-standard-setting evaluation is limited.
Objective
To apply a systematic, multi-source approach to enhance the validity and defensibility of cut-off scores derived through a modified Angoff procedure in a high-stakes medical examination.
Methods
A cross-sectional study was conducted using a final-year MBBS exit examination comprising a Multiple-Choice Question (MCQ) test and an Objective Structured Clinical Examination (OSCE). Fifteen experienced faculty applied the Modified Angoff method to determine initial cut scores. Validity evidence was collected through pre- and post-judgment surveys, psychometric analyses, and acceptability surveys involving students, judges, and medical education experts. Descriptive statistics, standard error adjustments, and independent t-tests were used.
Results
Initial cut scores were 64.44/100 (MCQ) and 12.85/20 (OSCE). Judges showed high clarity, confidence, and agreement. Psychometric analysis revealed limited score variability, indicating consistent performance. Cut scores were adjusted upward by one standard error, a theoretically justified approach intended to reduce potential false-positive classifications. Acceptability was high among judges and students, with no significant group differences.
Conclusion
Post standard setting evaluation added validity evidence, reinforcing the credibility and acceptability of cut off scores in high stakes examinations.
Schlagwörter
Zitieren
APA
Amare, Misganaw, E., Zerihun, Bekele, A., McCall, Natali, Jimma, Tadesse, T., Abdelrahman, Fadlelmoula, H. A., Belachew, Gadisa, A., Zelelew, Ewneti, B., Ibrahim, & Rasheed, O. (2026). Enhancing the defensibility of cut scores: A multi-source evaluation of a modified Angoff standard-setting process in a high-stakes medical examination. GMS Journal for Medical Education, 43(7). https://doi.org/10.3205/zma001889
Vancouver
Amare, Misganaw E, Zerihun, Bekele A, McCall, Natali, et al. Enhancing the defensibility of cut scores: A multi-source evaluation of a modified Angoff standard-setting process in a high-stakes medical examination. GMS Journal for Medical Education. 2026;43(7). doi:10.3205/zma001889
BibTeX
@article{Amare2026,
author = {Amare and Misganaw, Equlinet and Zerihun and Bekele, Abebe and McCall and Natali and Jimma and Tadesse, Tefera and Abdelrahman and Fadlelmoula, Hiba Abuelgasim and Belachew and Gadisa, Anteneh and Zelelew and Ewneti, Biniam and Ibrahim and Rasheed, Olayinka},
title = {Enhancing the defensibility of cut scores: A multi-source evaluation of a modified Angoff standard-setting process in a high-stakes medical examination},
journal = {GMS Journal for Medical Education},
year = {2026},
volume = {43},
number = {7},
doi = {10.3205/zma001889}
}
EUVIMED