EUVIMEDEUVIMED entdecken
Crossref

Predicting item response theory estimates and response correctness with cyclic dual latent discovery in the Korean Medical Licensing Examination: a methodological study

Geonhee Yang, Dohyoung Rim

Journal of Educational Evaluation for Health Professions · 05.11.2026 · 23 · 35

DOI: 10.3352/jeehp.2026.23.35 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Educational Evaluation for Health Professions, online erschienen am 05.11.2026. Verfasst von Geonhee Yang und 1 weiteren Autor:innen. Beteiligte Einrichtung: Independent Researcher, Seoul, Korea. Hauptthemen laut MEDLINE: Educational Measurement, Licensure, Medical.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Purpose

We evaluated whether student and item representations learned from response correctness provide information about examinee and item characteristics, including item response theory (IRT) estimates, and whether this information translates into better response prediction.

Methods

We analyzed Korean Medical Licensing Examination (KMLE) responses from 3,259 examinees to 360 items. We froze 64-dimensional representations learned by cyclic dual latent discovery (CDLD) and assessed IRT prediction using nested cross-validation. Exploratory analyses compared the addition of CDLD, 64-dimensional representations based on singular value decomposition (SVD64), or random inputs to augmented response summaries. Across 5 splits, response prediction was compared with Rasch and 2-parameter logistic (2PL) models; 0–40 responses from new examinees were used for adaptation.

Results

In exploratory comparisons, adding CDLD to augmented response summaries increased R2 from 0.9289 to 0.9843 for 2PL ability and from 0.8759 to 0.9216 for log discrimination. The increment for log discrimination was 0.0458 (95% confidence interval, 0.0163 to 0.0842), exceeding the increment with SVD64 by 0.0267 (0.0091 to 0.0457). Prediction of Rasch difficulty decreased negligibly, whereas improvement in 2PL difficulty was uncertain. Among existing KMLE examinees, CDLD and 2PL achieved areas under the curve of 0.8446 and 0.8451, respectively, for response prediction. With 40 adaptation responses from new examinees, the difference in score correlation was −0.0179, and noninferiority was not established.

Conclusion

Exploratory comparisons showed that CDLD provided additional information about KMLE 2PL ability and log discrimination, but did not support its adoption as a superior predictor of responses or student scores.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Educational MeasurementLicensure, MedicalRepublic of KoreaHumans

Stichwörter der Autor:innen

Educational measurementLicensure, medicalNeural networks, computerPsychometricsRepublic of Korea

Autor:innen und Institutionen

  • Independent Researcher, Seoul, Korea.
  • Independent Researcher, Seoul, Korea. dh-rim@hanmail.net.

Zitieren

APA

Yang, G., & Rim, D. (2026). Predicting item response theory estimates and response correctness with cyclic dual latent discovery in the Korean Medical Licensing Examination: a methodological study. Journal of Educational Evaluation for Health Professions, 23, 35. https://doi.org/10.3352/jeehp.2026.23.35

Vancouver

Yang G, Rim D. Predicting item response theory estimates and response correctness with cyclic dual latent discovery in the Korean Medical Licensing Examination: a methodological study. Journal of Educational Evaluation for Health Professions. 2026;23:35. doi:10.3352/jeehp.2026.23.35

BibTeX
@article{Yang2026,
  author = {Yang, Geonhee and Rim, Dohyoung},
  title = {Predicting item response theory estimates and response correctness with cyclic dual latent discovery in the Korean Medical Licensing Examination: a methodological study},
  journal = {Journal of Educational Evaluation for Health Professions},
  year = {2026},
  volume = {23},
  pages = {35},
  doi = {10.3352/jeehp.2026.23.35}
}
Kostenlos starten →