Possibility of independent use of the yes/no Angoff and Hofstee methods for the standard setting of the Korean Medical Licensing Examination written test: a descriptive study
Journal of Educational Evaluation for Health Professions · 12.12.2022 · 19 · 33
DOI: 10.3352/jeehp.2022.19.33 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Educational Evaluation for Health Professions, online erschienen am 12.12.2022. Verfasst von Do-Hwan Kim und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Medical Education, Hanyang University College of Medicine, Seoul, Korea. Hauptthemen laut MEDLINE: Educational Measurement, Clinical Competence. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 12 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Korea Health Personnel Licensing Examination Institut.
Abstract (Originalsprache)
Purpose
This study aims to apply the yes/no Angoff and Hofstee methods to actual Korean Medical Licensing Examination (KMLE) 2022 written examination data to estimate cut scores for the written KMLE.
Methods
Fourteen panelists gathered to derive the cut score of the 86th KMLE written examination data using the yes/no Angoff method. The panel reviewed the items individually before the meeting and shared their respective understanding of the minimum-compatibility physician. The standard setting process was conducted in 5 rounds over a total of 800 minutes. In addition, 2 rounds of the Hofstee method were conducted before starting the standard setting process and after the second round of yes/no Angoff.
Results
For yes/no Angoff, as each round progressed, the panel’s opinion gradually converged to a cut score of 198 points, and the final passing rate was 95.1%. The Hofstee cut score was 208 points out of a maximum 320 with a passing rate of 92.1% at the first round. It scored 204 points with a passing rate of 93.3% in the second round.
Conclusion
The difference between the cut scores obtained through yes/no Angoff and Hofstee methods did not exceed 2% points, and they were within the range of cut scores from previous studies. In both methods, the difference between the panelists decreased as rounds were repeated. Overall, our findings suggest the acceptability of cut scores and the possibility of independent use of both methods.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Medical Education, Hanyang University College of Medicine, Seoul, Korea.
- Department of Family Medicine, Hanyang University College of Medicine, Seoul, Korea.
Förderung
- Korea Health Personnel Licensing Examination Institut
Zitieren
APA
Kim, D. H., Kang, Y. J., & Park, H. K. (2022). Possibility of independent use of the yes/no Angoff and Hofstee methods for the standard setting of the Korean Medical Licensing Examination written test: a descriptive study. Journal of Educational Evaluation for Health Professions, 19, 33. https://doi.org/10.3352/jeehp.2022.19.33
Vancouver
Kim DH, Kang YJ, Park HK. Possibility of independent use of the yes/no Angoff and Hofstee methods for the standard setting of the Korean Medical Licensing Examination written test: a descriptive study. Journal of Educational Evaluation for Health Professions. 2022;19:33. doi:10.3352/jeehp.2022.19.33
BibTeX
@article{Kim2022,
author = {Kim, Do-Hwan and Kang, Ye Ji and Park, Hoon-Ki},
title = {Possibility of independent use of the yes/no Angoff and Hofstee methods for the standard setting of the Korean Medical Licensing Examination written test: a descriptive study},
journal = {Journal of Educational Evaluation for Health Professions},
year = {2022},
volume = {19},
pages = {33},
doi = {10.3352/jeehp.2022.19.33}
}
EUVIMED