EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Possibility of using the yes/no Angoff method as a substitute for the percent Angoff method for estimating the cutoff score of the Korean Medical Licensing Examination: a simulation study

Janghee Park

Journal of Educational Evaluation for Health Professions · 31.08.2022 · 19 · 23

DOI: 10.3352/jeehp.2022.19.23 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Educational Evaluation for Health Professions, online erschienen am 31.08.2022. Verfasst von Janghee Park. Beteiligte Einrichtung: Department of Medical Education, Soonchunhyang University College of Medicine, Cheonan, Korea. Hauptthemen laut MEDLINE: Clinical Competence, Educational Measurement. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 12 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Soonchunhyang University Research Fund.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Purpose

The percent Angoff (PA) method has been recommended as a reliable method to set the cutoff score instead of a fixed cut point of 60% in the Korean Medical Licensing Examination (KMLE). The yes/no Angoff (YNA) method, which is easy for panelists to judge, can be considered as an alternative because the KMLE has many items to evaluate. This study aimed to compare the cutoff score and the reliability depending on whether the PA or the YNA standard-setting method was used in the KMLE.

Methods

The materials were the open-access PA data of the KMLE. The PA data were converted to YNA data in 5 categories, in which the probabilities for a “yes” decision by panelists were 50%, 60%, 70%, 80%, and 90%. SPSS for descriptive analysis and G-string for generalizability theory were used to present the results.

Results

The PA method and the YNA method counting 60% as “yes,” estimated similar cutoff scores. Those cutoff scores were deemed acceptable based on the results of the Hofstee method. The highest reliability coefficients estimated by the generalizability test were from the PA method and the YNA method, with probabilities of 70%, 80%, 60%, and 50% for deciding “yes,” in descending order. The panelist’s specialty was the main cause of the error variance. The error size was similar regardless of the standard-setting method.

Conclusion

The above results showed that the PA method was more reliable than the YNA method in estimating the cutoff score of the KMLE. However, the YNA method with a 60% probability for deciding “yes” also can be used as a substitute for the PA method in estimating the cutoff score of the KMLE.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Clinical CompetenceEducational MeasurementHumansLicensureReproducibility of ResultsRepublic of Korea

Stichwörter der Autor:innen

Educational measurementProbabilityReproducibility of resultsRepublic of Korea

Autor:innen und Institutionen

  • Department of Medical Education, Soonchunhyang University College of Medicine, Cheonan, Korea

Förderung

  • Soonchunhyang University Research Fund

Zitieren

APA

Park, J. (2022). Possibility of using the yes/no Angoff method as a substitute for the percent Angoff method for estimating the cutoff score of the Korean Medical Licensing Examination: a simulation study. Journal of Educational Evaluation for Health Professions, 19, 23. https://doi.org/10.3352/jeehp.2022.19.23

Vancouver

Park J. Possibility of using the yes/no Angoff method as a substitute for the percent Angoff method for estimating the cutoff score of the Korean Medical Licensing Examination: a simulation study. Journal of Educational Evaluation for Health Professions. 2022;19:23. doi:10.3352/jeehp.2022.19.23

BibTeX
@article{Park2022,
  author = {Park, Janghee},
  title = {Possibility of using the yes/no Angoff method as a substitute for the percent Angoff method for estimating the cutoff score of the Korean Medical Licensing Examination: a simulation study},
  journal = {Journal of Educational Evaluation for Health Professions},
  year = {2022},
  volume = {19},
  pages = {23},
  doi = {10.3352/jeehp.2022.19.23}
}
Kostenlos starten →