Preparing Emergency Medicine Residents for the Certifying Exam: A Pilot Study of a Longitudinal Simulation‐Based Assessment Program
AEM Education and Training · 2026-06 · 10 (3)
DOI: 10.1002/aet2.70172 ↗Kurz gefasst
Fachartikel in der Zeitschrift AEM Education and Training, online erschienen am 11.05.2026. Verfasst von Jennifer Yee und 13 weiteren Autor:innen. Beteiligte Einrichtung: Department of Emergency Medicine the Ohio State University College of Medicine Columbus Ohio USA. Die Arbeit nennt 38 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).
Abstract (Originalsprache)
Background
The American Board of Emergency Medicine (ABEM) has recently introduced a new Certifying Exam, which incorporates assessment of performance in a simulated clinical environment. Simulation‐based assessments allow for reproducible, controlled evaluations. The residency program has a responsibility to prepare residents for the Certifying Exam and to verify resident competency. We sought to determine the feasibility of a simulation‐based assessment program encompassing three domains (resuscitation, procedural skills, and communication) with assessments against pre‐determined Minimum Competency Scores (MCS) to provide evidence for program director attestations of competence.
Methods
Eight stations were chosen based on ABEM's Certifying Exam content, the Accreditation Council for Graduate Medical Education (ACGME) Milestones, and proposed Entrustable Professional Activities. Simulation‐based case scenarios and assessment checklists were created with standard settings performed using the Mastery Angoff process. These stations were categorized into three different domains: resuscitation (Adult Medical, Pediatric Medical, Trauma, and Neonatal), procedural skills (Direct Laryngoscopy, Cricothyrotomy, and Central Venous Catheter Placement), and communication (Breaking Bad News). Results were summarized with descriptive statistics.
Results
Thirty emergency medicine residents at an academic Midwestern residency program underwent assessments over one year. None of the residents achieved the MCS on all eight assessments. Residents achieved the MCS on an average of 4.24 stations. There was large performance variability, particularly for the Pediatric Medical (27%–100% items correct), Neonatal Resuscitation (30%–100%), and Breaking Bad News (31%–100%) scenarios. A greater percentage of residents met the MCS for procedural assessments.
Conclusions
This pilot study demonstrated the feasibility of a simulation‐based assessment program designed to provide objective evidence of clinical competency. Assessment outcomes and associated feedback can be used by learners to guide the development of educational plans for performance improvement. Educators can use the resulting data to assess readiness for independent practice, prepare for the Certifying Exam, and identify content areas that may require additional program‐wide education.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Emergency Medicine the Ohio State University College of Medicine Columbus Ohio USA.
- Department of Pediatrics the Ohio State University College of Medicine Columbus Ohio USA.
- Department of Emergency Medicine University of California, San Francisco California California USA.
- Department of Emergency Medicine the University of Cincinnati College of Medicine Cincinnati Ohio USA.
ORCID-Profile: Christopher E San Miguel, Jennifer M Mitzman, Sally A Santen
Zitieren
APA
Yee, J., San Miguel, C. E., Miller, K. N., Li-Sauerwine, S., Emerson, G., Mitzman, J. M., Leung, C. G., Kaide, C. G., Ostro, B. M., Kendle, A. P., Panchal, A. R., Santen, S. A., Jordan, K. H., & Khandelwal, S. (2026). Preparing Emergency Medicine Residents for the Certifying Exam: A Pilot Study of a Longitudinal Simulation‐Based Assessment Program. AEM Education and Training, 10(3). https://doi.org/10.1002/aet2.70172
Vancouver
Yee J, San Miguel CE, Miller KN, Li-Sauerwine S, Emerson G, Mitzman JM, et al. Preparing Emergency Medicine Residents for the Certifying Exam: A Pilot Study of a Longitudinal Simulation‐Based Assessment Program. AEM Education and Training. 2026;10(3). doi:10.1002/aet2.70172
BibTeX
@article{Yee2026,
author = {Yee, Jennifer and San Miguel, Christopher E and Miller, Krystin N and Li-Sauerwine, Simiao and Emerson, Geremiha and Mitzman, Jennifer M and Leung, Cynthia G and Kaide, Colin G and Ostro, Benjamin M and Kendle, Andrew P and Panchal, Ashish R and Santen, Sally A and Jordan, Kelsey H and Khandelwal, Sorabh},
title = {Preparing Emergency Medicine Residents for the Certifying Exam: A Pilot Study of a Longitudinal Simulation‐Based Assessment Program},
journal = {AEM Education and Training},
year = {2026},
volume = {10},
number = {3},
doi = {10.1002/aet2.70172}
}
EUVIMED