EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Enhancing the defensibility of cut scores: A multi-source evaluation of a modified Angoff standard-setting process in a high-stakes medical examination

Amare, Equlinet Misganaw, Zerihun, Abebe Bekele, McCall, Natali, Jimma, Tefera Tadesse, Abdelrahman, Hiba Abuelgasim Fadlelmoula, Belachew, Anteneh Gadisa und 4 weitere

GMS Journal for Medical Education · 16.11.2026 · 43 (7)

DOI: 10.3205/zma001889 ↗

Kurz gefasst

Fachartikel in der Zeitschrift GMS Journal for Medical Education, erschienen am 16.11.2026. Verfasst von Amare und 15 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Introduction

Standard setting is essential in health professions education, yet establishing credible and defensible cut-off scores remains challenging, particularly when post-standard-setting evaluation is limited.

Objective

To apply a systematic, multi-source approach to enhance the validity and defensibility of cut-off scores derived through a modified Angoff procedure in a high-stakes medical examination.

Methods

A cross-sectional study was conducted using a final-year MBBS exit examination comprising a Multiple-Choice Question (MCQ) test and an Objective Structured Clinical Examination (OSCE). Fifteen experienced faculty applied the Modified Angoff method to determine initial cut scores. Validity evidence was collected through pre- and post-judgment surveys, psychometric analyses, and acceptability surveys involving students, judges, and medical education experts. Descriptive statistics, standard error adjustments, and independent t-tests were used.

Results

Initial cut scores were 64.44/100 (MCQ) and 12.85/20 (OSCE). Judges showed high clarity, confidence, and agreement. Psychometric analysis revealed limited score variability, indicating consistent performance. Cut scores were adjusted upward by one standard error, a theoretically justified approach intended to reduce potential false-positive classifications. Acceptability was high among judges and students, with no significant group differences.

Conclusion

Post standard setting evaluation added validity evidence, reinforcing the credibility and acceptability of cut off scores in high stakes examinations.

Schlagwörter

standard settingmodified Angoff methodcut-off scorehigh-stakes examinationRwanda

Zitieren

APA

Amare, Misganaw, E., Zerihun, Bekele, A., McCall, Natali, Jimma, Tadesse, T., Abdelrahman, Fadlelmoula, H. A., Belachew, Gadisa, A., Zelelew, Ewneti, B., Ibrahim, & Rasheed, O. (2026). Enhancing the defensibility of cut scores: A multi-source evaluation of a modified Angoff standard-setting process in a high-stakes medical examination. GMS Journal for Medical Education, 43(7). https://doi.org/10.3205/zma001889

Vancouver

Amare, Misganaw E, Zerihun, Bekele A, McCall, Natali, et al. Enhancing the defensibility of cut scores: A multi-source evaluation of a modified Angoff standard-setting process in a high-stakes medical examination. GMS Journal for Medical Education. 2026;43(7). doi:10.3205/zma001889

BibTeX
@article{Amare2026,
  author = {Amare and Misganaw, Equlinet and Zerihun and Bekele, Abebe and McCall and Natali and Jimma and Tadesse, Tefera and Abdelrahman and Fadlelmoula, Hiba Abuelgasim and Belachew and Gadisa, Anteneh and Zelelew and Ewneti, Biniam and Ibrahim and Rasheed, Olayinka},
  title = {Enhancing the defensibility of cut scores: A multi-source evaluation of a modified Angoff standard-setting process in a high-stakes medical examination},
  journal = {GMS Journal for Medical Education},
  year = {2026},
  volume = {43},
  number = {7},
  doi = {10.3205/zma001889}
}
Kostenlos starten →