EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Feasibility of applying computerized adaptive testing to the Clinical Medical Science Comprehensive Examination in Korea: a psychometric study

Jeongwook Choi, Sung-Soo Jung, Eun Kwang Choi, Kyung Sik Kim, Dong Gi Seo

Journal of Educational Evaluation for Health Professions · 2025

DOI: 10.3352/jeehp.2025.22.29 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Educational Evaluation for Health Professions, 2025. Verfasst von Jeongwook Choi und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychology, College of Social Science, Hallym University, Chuncheon, Korea. Hauptthemen laut MEDLINE: Educational Measurement, Students, Medical, Clinical Competence. Die Arbeit nennt 7 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministry of Education, National Research Foundation of Korea.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Purpose

This study aimed to investigate the feasibility of transitioning the Clinical Medical Science Comprehensive Examination (CMSCE) to computerized adaptive testing (CAT) in Korea, thereby providing greater opportunities for medical students to accurately compare their clinical competencies with peers nationwide and to monitor their own progress.

Methods

A medical self-assessment using CAT was conducted from March to June 2023, involving 1,541 medical students who volunteered from 40 medical colleges in Korea. An item bank consisting of 1,145 items from previously administered CMSCE examinations (2019–2021) hosted by the Medical Education Assessment Corporation was established. Items were selected through 2-stage filtering, based on classical test theory (discrimination index above 0.15) and item response theory (discrimination parameter estimates above 0.6 and difficulty parameter estimates between –5 and +5). Maximum Fisher information was employed as the item selection method, and maximum likelihood estimation was used for ability estimation.

Results

The CAT was successfully administered without significant issues. The stopping rule was set at a standard error of measurement of 0.25, with a maximum of 50 items for ability estimation. The mean ability score was 0.55, with an average of 28 items administered per student. Students at extreme ability levels reached the maximum of 50 items due to the limited availability of items at appropriate difficulty levels.

Conclusion

The medical self-assessment CAT, the first of its kind in Korea, was successfully implemented nationwide without significant problems. These results indicate strong potential for expanding the use of CAT in medical education assessments.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Educational MeasurementStudents, MedicalClinical CompetenceHumansRepublic of KoreaPsychometricsFeasibility StudiesMaleFemaleEducation, Medical, UndergraduateSelf-Assessment

Stichwörter der Autor:innen

Clinical competenceComputerized adaptive testingMedical studentsPsychometricsRepublic of KoreaSelf-assessment

Autor:innen und Institutionen

  • Department of Psychology, College of Social Science, Hallym University, Chuncheon, Korea.
  • Department of Internal Medicine, Chungnam National University College of Medicine, Daejeon, Korea.
  • Department of Internal Medicine, Jeju National University College of Medicine, Jeju, Korea.
  • Department of Surgery, Yonsei University College of Medicine, Seoul, Korea.
  • Medical Education Assessment Corporation, Korea Association of Medical Colleges, Seoul, Korea.

Förderung

  • Ministry of Education
  • National Research Foundation of Korea

Zitieren

APA

Choi, J., Jung, S. S., Choi, E. K., Kim, K. S., & Seo, D. G. (2025). Feasibility of applying computerized adaptive testing to the Clinical Medical Science Comprehensive Examination in Korea: a psychometric study. Journal of Educational Evaluation for Health Professions. https://doi.org/10.3352/jeehp.2025.22.29

Vancouver

Choi J, Jung SS, Choi EK, Kim KS, Seo DG. Feasibility of applying computerized adaptive testing to the Clinical Medical Science Comprehensive Examination in Korea: a psychometric study. Journal of Educational Evaluation for Health Professions. 2025. doi:10.3352/jeehp.2025.22.29

BibTeX
@article{Choi2025,
  author = {Choi, Jeongwook and Jung, Sung-Soo and Choi, Eun Kwang and Kim, Kyung Sik and Seo, Dong Gi},
  title = {Feasibility of applying computerized adaptive testing to the Clinical Medical Science Comprehensive Examination in Korea: a psychometric study},
  journal = {Journal of Educational Evaluation for Health Professions},
  year = {2025},
  doi = {10.3352/jeehp.2025.22.29}
}
Kostenlos starten →