Variability in Standardized Letters of Evaluation: A Multi‐Institutional Review of EM Residency Based Versus Non‐Residency Based Faculty Evaluation
AEM Education and Training · 2026-02 · 10 (1)
DOI: 10.1002/aet2.70133 ↗Kurz gefasst
Fachartikel in der Zeitschrift AEM Education and Training, online erschienen am 16.02.2026. Verfasst von Katarzyna Gore und 11 weiteren Autor:innen. Beteiligte Einrichtung: Department of Emergency Medicine Rush University Medical Center Chicago Illinois USA. Die Arbeit nennt 11 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Background
The Standardized Letter of Evaluation (SLOE) in Emergency Medicine (EM) was developed by the Council of Residency Directors in Emergency Medicine (CORD) to have a uniform approach to providing training programs with information about applicants in the match process. Recent revisions distinguish what setting letter writers originate (residency based [RB] training program vs. non‐residency based [nRB] site).
Objectives
The goal of this paper was to compare SLOE 2.0 scoring between letter writers from RB versus nRB settings.
Methods
This was a multi‐institutional cross‐sectional study. The study team from five residency programs collected data from SLOEs in their applicant pool from 2022 to 2023 match cycle. Each SLOE was reviewed for training location/SLOE type (RB vs. nRB) and numerical scores for sections A, B, and C (Anticipated Guidance [AG]). The data were not normally distributed, so were analyzed using descriptive and chi‐squared statistics. Data were examined using Spearman's Rho ( ⍴ ) to evaluate the relationship of Part A and B scores with faculty estimates of AG.
Results
The study analyzed 3687 eSLOEs from 1772 applicants. The majority ( N = 3526) were from RB faculty with only 161 from nRB faculty. The median scores were similar between groups, but the distribution of Part A and B scores was different between RB and nRB faculty. One exception was A4 (ability to perform common ED procedures) which had similar proportions of scores. There was a positive monotonic relationship between evaluation scores (Part A and B) and faculty estimates for AG, predicting up to 30% variability. Overall eSLOEs from nRB faculty had higher proportions of higher scores.
Conclusions
This study found a significant difference in proportions of scores assigned between RB faculty versus nRB faculty on most items including AG.
Autor:innen und Institutionen
- Department of Emergency Medicine Rush University Medical Center Chicago Illinois USA.
- Department of Emergency Medicine HealthPartners Institute/Regions Hospital St. Paul Minnesota USA.
- Department of Emergency Medicine University of Florida College of Medicine Jacksonville Florida USA.
- Department of Emergency Medicine Stanford University Stanford California USA.
- Department of Medicine McMaster University Hamilton Ontario Canada.
- Department of Emergency Medicine The Johns Hopkins University School of Medicine Baltimore Maryland USA.
ORCID-Profile: Katarzyna Gore, Sandra Monteiro
Zitieren
APA
Gore, K., Hegarty, C. B., Beardsley, T., Krzyzaniak, S. M., Monteiro, S., Alvarez, A., Davis, T., Parsons, M., Pandey, A., Bord, S., Gottlieb, M., & Mannix, A. (2026). Variability in Standardized Letters of Evaluation: A Multi‐Institutional Review of EM Residency Based Versus Non‐Residency Based Faculty Evaluation. AEM Education and Training, 10(1). https://doi.org/10.1002/aet2.70133
Vancouver
Gore K, Hegarty CB, Beardsley T, Krzyzaniak SM, Monteiro S, Alvarez A, et al. Variability in Standardized Letters of Evaluation: A Multi‐Institutional Review of EM Residency Based Versus Non‐Residency Based Faculty Evaluation. AEM Education and Training. 2026;10(1). doi:10.1002/aet2.70133
BibTeX
@article{Gore2026,
author = {Gore, Katarzyna and Hegarty, Cullen B and Beardsley, Thomas and Krzyzaniak, Sara M and Monteiro, Sandra and Alvarez, Al'ai and Davis, Teresa and Parsons, Melissa and Pandey, Aman and Bord, Sharon and Gottlieb, Michael and Mannix, Alexandra},
title = {Variability in Standardized Letters of Evaluation: A Multi‐Institutional Review of EM Residency Based Versus Non‐Residency Based Faculty Evaluation},
journal = {AEM Education and Training},
year = {2026},
volume = {10},
number = {1},
doi = {10.1002/aet2.70133}
}
EUVIMED