Predicting Step 2 CK Performance Using Automated Feature Selection and Nested Cross-Validation
Journal of Medical Education and Curricular Development · 2026-08 · 13
DOI: 10.1177/23821205261474043 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Medical Education and Curricular Development, online erschienen am 05.08.2026. Verfasst von Padraig Mark Healy und 1 weiteren Autor:innen. Beteiligte Einrichtung: Office of Evaluation, Assessment and Student Informatics, Division of Medical Education, Weill Cornell Medicine - Qatar, Doha, Qatar. Die Arbeit nennt 43 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Background
Given the recent transition of the USMLE Step 1 exam to a pass/fail system, evaluative emphasis is expected to shift toward the USMLE Step 2 Clinical Knowledge (USMLE-CK) exam, prompting the need for advanced predictive models. In this study, we proposed a multiple linear regression approach incorporating automated feature selection to predict students’ performance on the USMLE-CK exam.
Methods
Our methodology integrated feature selection and model validation processes within a nested cross-validation (CV) framework to predict USMLE-CK scores. We conducted our analysis on data from four undergraduate medical student cohorts (Classes 2020 to 2023 inclusive, n = 117). A range of performance data was included for feature selection, including internal assessment data and National Board Medical Examination (NBME) Clinical Science Subject Exams scores. Utilizing nested CV, we constructed and assessed multiple regression models using four model evaluation metrics: mean CV error, adjusted-R 2 , Mallows’ Cp, and Bayesian Information Criteria.
Results
This led to the selection of a four-predictor model (adjusted-R 2 = 0.68). This model incorporated a combination of NBME exams (Medicine, Neurology and Surgery) and performance in a pre-clinical unit (Gastrointestinal).
Conclusion
Our approach effectively streamlined the process of building a predictive model by merging feature selection with model validation. By creating an interactive, user-friendly dashboard, we empower medical educators to predict students’ USMLE-CK performance. This modeling and deployment approach holds promise for predicting student performances in other assessments.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Office of Evaluation, Assessment and Student Informatics, Division of Medical Education, Weill Cornell Medicine - Qatar, Doha, Qatar.
ORCID-Profile: Padraig Mark Healy, Syed Latifi
Zitieren
APA
Healy, P. M., & Latifi, S. (2026). Predicting Step 2 CK Performance Using Automated Feature Selection and Nested Cross-Validation. Journal of Medical Education and Curricular Development, 13. https://doi.org/10.1177/23821205261474043
Vancouver
Healy PM, Latifi S. Predicting Step 2 CK Performance Using Automated Feature Selection and Nested Cross-Validation. Journal of Medical Education and Curricular Development. 2026;13. doi:10.1177/23821205261474043
BibTeX
@article{Healy2026,
author = {Healy, Padraig Mark and Latifi, Syed},
title = {Predicting Step 2 CK Performance Using Automated Feature Selection and Nested Cross-Validation},
journal = {Journal of Medical Education and Curricular Development},
year = {2026},
volume = {13},
doi = {10.1177/23821205261474043}
}
EUVIMED