Blueprint‐Driven Consolidation Improves Preclinical Exam Reliability and Validity
The Clinical Teacher · 2026-06 · 23 (3)
DOI: 10.1111/tct.70433 ↗Kurz gefasst
Fachartikel in der Zeitschrift The Clinical Teacher, online erschienen am 30.04.2026. Verfasst von G L Beasley und 1 weiteren Autor:innen. Beteiligte Einrichtung: College of Medicine, University of Florida, Gainesville, Florida, USA. Hauptthemen laut MEDLINE: Educational Measurement, Education, Medical, Undergraduate, Gastroenterology. Die Arbeit nennt 19 Literaturangaben.
Abstract (Originalsprache)
Background
Best‐practice item writing and blueprint alignment are recommended for medical school assessments, yet few studies examine whether exam redesign improves both psychometric quality and external validity of preclinical block exams in the Step 1 pass/fail era. We therefore examined how consolidating two moderate‐reliability gastroenterology (GI) examinations into a single vignette‐based exam affected reliability and its relationship with the NBME Comprehensive Basic Science Examination (CBSE). Approach We conducted a retrospective analysis of six cohorts (2019–2025; N = 867) who completed the GI examination(s) and the CBSE. Item statistics and KR‐20 reliability coefficients were obtained from the examination platform. Associations between exam average and CBSE total and GI subsection scores were evaluated using Spearman correlations ( ρ ), and cohort trends were explored using Welch‐corrected ANOVA. Evaluation Mean exam average declined modestly (91.6–86.1), whereas CBSE means were stable (≈57–67). Exam reliability rose steadily (KR‐20 = 0.51–0.75), with the largest gain after blueprint revision (0.55–0.69). Across all students, exam average correlated moderately with CBSE total ( ρ = 0.44, p < 0.001) and GI subsection ( ρ = 0.36, p < 0.001). Cohort‐specific correlations strengthened over time, increasing from ρ = 0.36 in 2019–2020 to ρ = 0.57 in 2024–2025; cohorts with KR‐20 ≥ 0.65 demonstrated stronger predictive validity than earlier cohorts.
Implications
A clinician‐led, vignette‐rich, blueprint‐driven redesign improved exam reliability and strengthened alignment with national benchmarks despite reduced testing frequency, supporting clinically integrated assessments as a strategy to enhance step‐readiness without increasing assessment burden.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- College of Medicine, University of Florida, Gainesville, Florida, USA.
ORCID-Profile: G L Beasley
Zitieren
APA
Beasley, G. L., & Huynh, P. H. (2026). Blueprint‐Driven Consolidation Improves Preclinical Exam Reliability and Validity. The Clinical Teacher, 23(3). https://doi.org/10.1111/tct.70433
Vancouver
Beasley GL, Huynh PH. Blueprint‐Driven Consolidation Improves Preclinical Exam Reliability and Validity. The Clinical Teacher. 2026;23(3). doi:10.1111/tct.70433
BibTeX
@article{Beasley2026,
author = {Beasley, G L and Huynh, P H},
title = {Blueprint‐Driven Consolidation Improves Preclinical Exam Reliability and Validity},
journal = {The Clinical Teacher},
year = {2026},
volume = {23},
number = {3},
doi = {10.1111/tct.70433}
}
EUVIMED