Feasibility of applying computerized adaptive testing to the Clinical Medical Science Comprehensive Examination in Korea: a psychometric study
Journal of Educational Evaluation for Health Professions · 2025
DOI: 10.3352/jeehp.2025.22.29 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Educational Evaluation for Health Professions, 2025. Verfasst von Jeongwook Choi und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychology, College of Social Science, Hallym University, Chuncheon, Korea. Hauptthemen laut MEDLINE: Educational Measurement, Students, Medical, Clinical Competence. Die Arbeit nennt 7 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministry of Education, National Research Foundation of Korea.
Abstract (Originalsprache)
Purpose
This study aimed to investigate the feasibility of transitioning the Clinical Medical Science Comprehensive Examination (CMSCE) to computerized adaptive testing (CAT) in Korea, thereby providing greater opportunities for medical students to accurately compare their clinical competencies with peers nationwide and to monitor their own progress.
Methods
A medical self-assessment using CAT was conducted from March to June 2023, involving 1,541 medical students who volunteered from 40 medical colleges in Korea. An item bank consisting of 1,145 items from previously administered CMSCE examinations (2019–2021) hosted by the Medical Education Assessment Corporation was established. Items were selected through 2-stage filtering, based on classical test theory (discrimination index above 0.15) and item response theory (discrimination parameter estimates above 0.6 and difficulty parameter estimates between –5 and +5). Maximum Fisher information was employed as the item selection method, and maximum likelihood estimation was used for ability estimation.
Results
The CAT was successfully administered without significant issues. The stopping rule was set at a standard error of measurement of 0.25, with a maximum of 50 items for ability estimation. The mean ability score was 0.55, with an average of 28 items administered per student. Students at extreme ability levels reached the maximum of 50 items due to the limited availability of items at appropriate difficulty levels.
Conclusion
The medical self-assessment CAT, the first of its kind in Korea, was successfully implemented nationwide without significant problems. These results indicate strong potential for expanding the use of CAT in medical education assessments.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Psychology, College of Social Science, Hallym University, Chuncheon, Korea.
- Department of Internal Medicine, Chungnam National University College of Medicine, Daejeon, Korea.
- Department of Internal Medicine, Jeju National University College of Medicine, Jeju, Korea.
- Department of Surgery, Yonsei University College of Medicine, Seoul, Korea.
- Medical Education Assessment Corporation, Korea Association of Medical Colleges, Seoul, Korea.
Förderung
- Ministry of Education
- National Research Foundation of Korea
Zitieren
APA
Choi, J., Jung, S. S., Choi, E. K., Kim, K. S., & Seo, D. G. (2025). Feasibility of applying computerized adaptive testing to the Clinical Medical Science Comprehensive Examination in Korea: a psychometric study. Journal of Educational Evaluation for Health Professions. https://doi.org/10.3352/jeehp.2025.22.29
Vancouver
Choi J, Jung SS, Choi EK, Kim KS, Seo DG. Feasibility of applying computerized adaptive testing to the Clinical Medical Science Comprehensive Examination in Korea: a psychometric study. Journal of Educational Evaluation for Health Professions. 2025. doi:10.3352/jeehp.2025.22.29
BibTeX
@article{Choi2025,
author = {Choi, Jeongwook and Jung, Sung-Soo and Choi, Eun Kwang and Kim, Kyung Sik and Seo, Dong Gi},
title = {Feasibility of applying computerized adaptive testing to the Clinical Medical Science Comprehensive Examination in Korea: a psychometric study},
journal = {Journal of Educational Evaluation for Health Professions},
year = {2025},
doi = {10.3352/jeehp.2025.22.29}
}
EUVIMED