EUVIMEDEUVIMED entdecken
Crossref

Evaluation of a novel formative objective structured clinical examination for clinical reasoning processes in undergraduate medical education: a pilot study

Thai Ong iD, Hyeryung Lee, Su Somay, Christopher Feddock, David Gordon, Kristen Mitchell, Candace Pau

Academic Medicine · 2026

DOI: 10.1093/acamed/wvag008 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Academic Medicine, 2026. Verfasst von Thai Ong und 6 weiteren Autor:innen. Beteiligte Einrichtung: National Board of Medical Examiners, Philadelphia, PA, United States. Hauptthemen laut MEDLINE: Education, Medical, Undergraduate, Clinical Reasoning, Educational Measurement, Clinical Competence. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 26 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Purpose

Current clinical reasoning assessments rely mostly on outcome-based rather than process-based indicators, which fails to account for early reasoning processes that impact overall diagnostic accuracy. Between 2022 and 2024, the National Board of Medical Examiners collaborated with medical school faculty members to develop a formative objective structured clinical examination for clinical reasoning (OSCE-CR), which used standardized patient encounters to assess observed student behaviors in three clinical reasoning process subdomains. This study evaluates the psychometric properties of scores from a large-scale pilot study to inform the utility of OSCE-CR as a formative assessment in undergraduate medical education.

Method

The large-scale pilot study was conducted in fall 2023 and included 76 clerkship students across four different U.S. medical schools. All students completed four different standardized patient cases, and two trained faculty raters scored videos of each case-student combination on the three clinical reasoning process subdomains. Multivariate generalizability theory (G-theory) was used to evaluate score reliabilities (at the subdomain and composite levels), and generalized linear mixed modeling (GLMM) was used to evaluate the predictive utility of the subdomain scores on diagnostic accuracy.

Results

The multivariate G-theory results demonstrated acceptable subdomain (mean Φ coefficient = 0.466) and composite reliability estimates (mean Φ coefficient = 0.738). Reliability estimates were most influenced by number of cases, with the addition of more cases to the assessment yielding substantially higher reliability estimates, particularly at the subdomain level. The GLMM results indicated composite scores were a significant positive predictor of diagnostic accuracy (0.605; 95% CI, 0.053-1.157; P = .03).

Conclusions

The results provide initial psychometric evidence for use of OSCE-CR to measure and provide feedback on relevant clinical reasoning processes linked to diagnostic accuracy. By moving beyond outcome-based indicators, OSCE-CR enables students to practice these process-related behaviors to improve their clinical reasoning and reduce future diagnostic errors.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Education, Medical, UndergraduateClinical ReasoningEducational MeasurementClinical CompetenceStudents, MedicalPilot ProjectsHumansMalePsychometricsFemaleReproducibility of ResultsUnited States

Stichwörter der Autor:innen

clinical reasoningfeedbackgeneralizability theoryhypothesis generationobjective structured clinical examination

Autor:innen und Institutionen

  • National Board of Medical Examiners, Philadelphia, PA, United States.
  • School of Educational Foudations, Leadership, and Aviation, Oklahoma State University, Stillwater, OK, United States.
  • Department of Emergency Medicine, Duke University School of Medicine, Durham, NC, United States.
  • Department of Primary Care, University of New England, Biddeford, ME, United States.
  • Department of Clinical Science, Kaiser Permanente Bernard J. Tyson School of Medicine, Pasadena, CA, United States.

ORCID-Profile: Thai Ong

Zitieren

APA

Ong, T., Lee, H., Somay, S., Feddock, C., Gordon, D., Mitchell, K., & Pau, C. (2026). Evaluation of a novel formative objective structured clinical examination for clinical reasoning processes in undergraduate medical education: a pilot study. Academic Medicine. https://doi.org/10.1093/acamed/wvag008

Vancouver

Ong T, Lee H, Somay S, Feddock C, Gordon D, Mitchell K, et al. Evaluation of a novel formative objective structured clinical examination for clinical reasoning processes in undergraduate medical education: a pilot study. Academic Medicine. 2026. doi:10.1093/acamed/wvag008

BibTeX
@article{Ong2026,
  author = {Ong, Thai and Lee, Hyeryung and Somay, Su and Feddock, Christopher and Gordon, David and Mitchell, Kristen and Pau, Candace},
  title = {Evaluation of a novel formative objective structured clinical examination for clinical reasoning processes in undergraduate medical education: a pilot study},
  journal = {Academic Medicine},
  year = {2026},
  doi = {10.1093/acamed/wvag008}
}
Kostenlos starten →