A Structured Approach to Integrating Holistic Review Into Rank Order List Construction
AEM Education and Training · 2026-10 · 10 (5)
DOI: 10.1002/aet2.70268 ↗Kurz gefasst
Fachartikel in der Zeitschrift AEM Education and Training, online erschienen am 14.10.2026. Verfasst von Richard Austin und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Emergency Medicine, School of Medicine Southern Illinois University, Springfield Memorial Hospital Springfield Illinois USA. Die Arbeit nennt 15 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Background
Residency programs are increasingly seeking to incorporate holistic review into the selection of applicants to interview, but its integration into the creation of the rank order list (ROL) remains less known.
Objective
We sought to develop a formula that reflects holistic review of an applicant by incorporating key application elements identified by the residency program and that aligns with the final submitted ROL.
Methods
For the 2023–2024 application cycle, the leadership team from a single emergency medicine residency training program identified key attributes that characterized a successful resident. We then created a formula that weighted the identified elements to reflect our standard approach to applicant assessment. After submission of our ROL to the National Resident Matching Program, we compared the formula's performance to that of the final submitted ROL using linear regression.
Results
A total of 143 of 160 interviewed applicants placed on the final ROL and were analyzed. Seventeen applicants that were unranked or missing a Standardized Letter of Evaluation were excluded. The regression analysis showed that the rank formula closely approximated the final position on the ROL ( β = −14.38, 95% CI 15.94 to −12.83; R 2 = 0.69; p < 0.0001). A higher rank score was strongly associated with a lower ROL number, which indicated a more favorable placement.
Conclusions
Using a ROL formula may consistently sort applicants post‐interview and allow a leadership team to see when an applicant has moved outside their projected range, ensuring standardized placement on the ROL based on predefined attributes. We demonstrated a model that may assist in the comprehensive ranking of our residency applicants by incorporating elements of holistic review.
Autor:innen und Institutionen
- Department of Emergency Medicine, School of Medicine Southern Illinois University, Springfield Memorial Hospital Springfield Illinois USA.
- Center for Clinical Research, School of Medicine Southern Illinois University Springfield Illinois USA.
ORCID-Profile: Richard Austin, Sharon Kim
Zitieren
APA
Austin, R., Delfino, K., Kim, S., Tennill, R., & Tweet, M. (2026). A Structured Approach to Integrating Holistic Review Into Rank Order List Construction. AEM Education and Training, 10(5). https://doi.org/10.1002/aet2.70268
Vancouver
Austin R, Delfino K, Kim S, Tennill R, Tweet M. A Structured Approach to Integrating Holistic Review Into Rank Order List Construction. AEM Education and Training. 2026;10(5). doi:10.1002/aet2.70268
BibTeX
@article{Austin2026,
author = {Austin, Richard and Delfino, Kristin and Kim, Sharon and Tennill, Robert and Tweet, Marit},
title = {A Structured Approach to Integrating Holistic Review Into Rank Order List Construction},
journal = {AEM Education and Training},
year = {2026},
volume = {10},
number = {5},
doi = {10.1002/aet2.70268}
}
EUVIMED