Predicting item response theory estimates and response correctness with cyclic dual latent discovery in the Korean Medical Licensing Examination: a methodological study
Journal of Educational Evaluation for Health Professions · 05.11.2026 · 23 · 35
DOI: 10.3352/jeehp.2026.23.35 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Educational Evaluation for Health Professions, online erschienen am 05.11.2026. Verfasst von Geonhee Yang und 1 weiteren Autor:innen. Beteiligte Einrichtung: Independent Researcher, Seoul, Korea. Hauptthemen laut MEDLINE: Educational Measurement, Licensure, Medical.
Abstract (Originalsprache)
Purpose
We evaluated whether student and item representations learned from response correctness provide information about examinee and item characteristics, including item response theory (IRT) estimates, and whether this information translates into better response prediction.
Methods
We analyzed Korean Medical Licensing Examination (KMLE) responses from 3,259 examinees to 360 items. We froze 64-dimensional representations learned by cyclic dual latent discovery (CDLD) and assessed IRT prediction using nested cross-validation. Exploratory analyses compared the addition of CDLD, 64-dimensional representations based on singular value decomposition (SVD64), or random inputs to augmented response summaries. Across 5 splits, response prediction was compared with Rasch and 2-parameter logistic (2PL) models; 0–40 responses from new examinees were used for adaptation.
Results
In exploratory comparisons, adding CDLD to augmented response summaries increased R2 from 0.9289 to 0.9843 for 2PL ability and from 0.8759 to 0.9216 for log discrimination. The increment for log discrimination was 0.0458 (95% confidence interval, 0.0163 to 0.0842), exceeding the increment with SVD64 by 0.0267 (0.0091 to 0.0457). Prediction of Rasch difficulty decreased negligibly, whereas improvement in 2PL difficulty was uncertain. Among existing KMLE examinees, CDLD and 2PL achieved areas under the curve of 0.8446 and 0.8451, respectively, for response prediction. With 40 adaptation responses from new examinees, the difference in score correlation was −0.0179, and noninferiority was not established.
Conclusion
Exploratory comparisons showed that CDLD provided additional information about KMLE 2PL ability and log discrimination, but did not support its adoption as a superior predictor of responses or student scores.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Independent Researcher, Seoul, Korea.
- Independent Researcher, Seoul, Korea. dh-rim@hanmail.net.
Zitieren
APA
Yang, G., & Rim, D. (2026). Predicting item response theory estimates and response correctness with cyclic dual latent discovery in the Korean Medical Licensing Examination: a methodological study. Journal of Educational Evaluation for Health Professions, 23, 35. https://doi.org/10.3352/jeehp.2026.23.35
Vancouver
Yang G, Rim D. Predicting item response theory estimates and response correctness with cyclic dual latent discovery in the Korean Medical Licensing Examination: a methodological study. Journal of Educational Evaluation for Health Professions. 2026;23:35. doi:10.3352/jeehp.2026.23.35
BibTeX
@article{Yang2026,
author = {Yang, Geonhee and Rim, Dohyoung},
title = {Predicting item response theory estimates and response correctness with cyclic dual latent discovery in the Korean Medical Licensing Examination: a methodological study},
journal = {Journal of Educational Evaluation for Health Professions},
year = {2026},
volume = {23},
pages = {35},
doi = {10.3352/jeehp.2026.23.35}
}
EUVIMED