Evaluation of a novel formative objective structured clinical examination for clinical reasoning processes in undergraduate medical education: a pilot study
Academic Medicine · 2026
DOI: 10.1093/acamed/wvag008 ↗Kurz gefasst
Fachartikel in der Zeitschrift Academic Medicine, 2026. Verfasst von Thai Ong und 6 weiteren Autor:innen. Beteiligte Einrichtung: National Board of Medical Examiners, Philadelphia, PA, United States. Hauptthemen laut MEDLINE: Education, Medical, Undergraduate, Clinical Reasoning, Educational Measurement, Clinical Competence. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 26 Literaturangaben.
Abstract (Originalsprache)
Purpose
Current clinical reasoning assessments rely mostly on outcome-based rather than process-based indicators, which fails to account for early reasoning processes that impact overall diagnostic accuracy. Between 2022 and 2024, the National Board of Medical Examiners collaborated with medical school faculty members to develop a formative objective structured clinical examination for clinical reasoning (OSCE-CR), which used standardized patient encounters to assess observed student behaviors in three clinical reasoning process subdomains. This study evaluates the psychometric properties of scores from a large-scale pilot study to inform the utility of OSCE-CR as a formative assessment in undergraduate medical education.
Method
The large-scale pilot study was conducted in fall 2023 and included 76 clerkship students across four different U.S. medical schools. All students completed four different standardized patient cases, and two trained faculty raters scored videos of each case-student combination on the three clinical reasoning process subdomains. Multivariate generalizability theory (G-theory) was used to evaluate score reliabilities (at the subdomain and composite levels), and generalized linear mixed modeling (GLMM) was used to evaluate the predictive utility of the subdomain scores on diagnostic accuracy.
Results
The multivariate G-theory results demonstrated acceptable subdomain (mean Φ coefficient = 0.466) and composite reliability estimates (mean Φ coefficient = 0.738). Reliability estimates were most influenced by number of cases, with the addition of more cases to the assessment yielding substantially higher reliability estimates, particularly at the subdomain level. The GLMM results indicated composite scores were a significant positive predictor of diagnostic accuracy (0.605; 95% CI, 0.053-1.157; P = .03).
Conclusions
The results provide initial psychometric evidence for use of OSCE-CR to measure and provide feedback on relevant clinical reasoning processes linked to diagnostic accuracy. By moving beyond outcome-based indicators, OSCE-CR enables students to practice these process-related behaviors to improve their clinical reasoning and reduce future diagnostic errors.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- National Board of Medical Examiners, Philadelphia, PA, United States.
- School of Educational Foudations, Leadership, and Aviation, Oklahoma State University, Stillwater, OK, United States.
- Department of Emergency Medicine, Duke University School of Medicine, Durham, NC, United States.
- Department of Primary Care, University of New England, Biddeford, ME, United States.
- Department of Clinical Science, Kaiser Permanente Bernard J. Tyson School of Medicine, Pasadena, CA, United States.
ORCID-Profile: Thai Ong
Zitieren
APA
Ong, T., Lee, H., Somay, S., Feddock, C., Gordon, D., Mitchell, K., & Pau, C. (2026). Evaluation of a novel formative objective structured clinical examination for clinical reasoning processes in undergraduate medical education: a pilot study. Academic Medicine. https://doi.org/10.1093/acamed/wvag008
Vancouver
Ong T, Lee H, Somay S, Feddock C, Gordon D, Mitchell K, et al. Evaluation of a novel formative objective structured clinical examination for clinical reasoning processes in undergraduate medical education: a pilot study. Academic Medicine. 2026. doi:10.1093/acamed/wvag008
BibTeX
@article{Ong2026,
author = {Ong, Thai and Lee, Hyeryung and Somay, Su and Feddock, Christopher and Gordon, David and Mitchell, Kristen and Pau, Candace},
title = {Evaluation of a novel formative objective structured clinical examination for clinical reasoning processes in undergraduate medical education: a pilot study},
journal = {Academic Medicine},
year = {2026},
doi = {10.1093/acamed/wvag008}
}
EUVIMED