EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Predicting Step 2 CK Performance Using Automated Feature Selection and Nested Cross-Validation

Padraig Mark Healy iD, Syed Latifi iD

Journal of Medical Education and Curricular Development · 2026-08 · 13

DOI: 10.1177/23821205261474043 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Medical Education and Curricular Development, online erschienen am 05.08.2026. Verfasst von Padraig Mark Healy und 1 weiteren Autor:innen. Beteiligte Einrichtung: Office of Evaluation, Assessment and Student Informatics, Division of Medical Education, Weill Cornell Medicine - Qatar, Doha, Qatar. Die Arbeit nennt 43 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Given the recent transition of the USMLE Step 1 exam to a pass/fail system, evaluative emphasis is expected to shift toward the USMLE Step 2 Clinical Knowledge (USMLE-CK) exam, prompting the need for advanced predictive models. In this study, we proposed a multiple linear regression approach incorporating automated feature selection to predict students’ performance on the USMLE-CK exam.

Methods

Our methodology integrated feature selection and model validation processes within a nested cross-validation (CV) framework to predict USMLE-CK scores. We conducted our analysis on data from four undergraduate medical student cohorts (Classes 2020 to 2023 inclusive, n = 117). A range of performance data was included for feature selection, including internal assessment data and National Board Medical Examination (NBME) Clinical Science Subject Exams scores. Utilizing nested CV, we constructed and assessed multiple regression models using four model evaluation metrics: mean CV error, adjusted-R 2 , Mallows’ Cp, and Bayesian Information Criteria.

Results

This led to the selection of a four-predictor model (adjusted-R 2 = 0.68). This model incorporated a combination of NBME exams (Medicine, Neurology and Surgery) and performance in a pre-clinical unit (Gastrointestinal).

Conclusion

Our approach effectively streamlined the process of building a predictive model by merging feature selection with model validation. By creating an interactive, user-friendly dashboard, we empower medical educators to predict students’ USMLE-CK performance. This modeling and deployment approach holds promise for predicting student performances in other assessments.

Schlagwörter

Stichwörter der Autor:innen

USMLE step 2 CKinteractive dashboardmachine learningnested cross-validationpredictive model

Autor:innen und Institutionen

  • Office of Evaluation, Assessment and Student Informatics, Division of Medical Education, Weill Cornell Medicine - Qatar, Doha, Qatar.

ORCID-Profile: Padraig Mark Healy, Syed Latifi

Zitieren

APA

Healy, P. M., & Latifi, S. (2026). Predicting Step 2 CK Performance Using Automated Feature Selection and Nested Cross-Validation. Journal of Medical Education and Curricular Development, 13. https://doi.org/10.1177/23821205261474043

Vancouver

Healy PM, Latifi S. Predicting Step 2 CK Performance Using Automated Feature Selection and Nested Cross-Validation. Journal of Medical Education and Curricular Development. 2026;13. doi:10.1177/23821205261474043

BibTeX
@article{Healy2026,
  author = {Healy, Padraig Mark and Latifi, Syed},
  title = {Predicting Step 2 CK Performance Using Automated Feature Selection and Nested Cross-Validation},
  journal = {Journal of Medical Education and Curricular Development},
  year = {2026},
  volume = {13},
  doi = {10.1177/23821205261474043}
}
Kostenlos starten →