EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Using an Automated Evaluation System to Improve Medical Student Evaluation Response Rate and Reduce Administrative Burden

Chaiya Laoteppitaks iD, Alisha Agarwal, Jason Gonzalez iD, Nina Mingioni iD, Xiao Chi Zhang iD

AEM Education and Training · 2026-10 · 10 (5)

DOI: 10.1002/aet2.70257 ↗

Kurz gefasst

Fachartikel in der Zeitschrift AEM Education and Training, online erschienen am 23.09.2026. Verfasst von Chaiya Laoteppitaks und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Emergency Medicine Thomas Jefferson University Philadelphia Pennsylvania USA. Die Arbeit nennt 10 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Email reminders facilitate timely task completion but can create substantial administrative burdens for clerkship staff. In our emergency medicine (EM) clerkship, third‐year medical students initiate digital evaluation requests after each clinical shift, requiring frequent manual reminders to maintain completion rates. The time‐intensive nature of this process highlights the need for a more efficient and scalable approach.

Methods

This multi‐site, pre‐post study evaluated clinical performance evaluation completion rates and time to completion during the required EM clerkship over 48 weeks before and after implementation of an automated reminder system in September 2024. The system integrated existing survey functionality with Microsoft Excel and Microsoft Power Automate to track evaluation requests and completion and generate reminders every 2 days for up to 28 days. Primary outcomes were evaluation completion rate and time to completion. A theoretical cost analysis compared estimated personnel costs of the manual reminder process, based on administrator time and median salary estimates, with projected programming development and maintenance costs over 3 years.

Results

A total of 5747 evaluations were sent during this period to attending and resident evaluators. Overall completion rate rose modestly post‐intervention (71.4% to 75.1%, p < 0.001), with attending evaluation rate demonstrating greater improvement from 73.9% to 81.6% ( p < 0.001). Conversely, both resident (median 2.67 to 3.98 days) and attending completion time increased (median 2.59 to 2.74 days), p = 0.002. Based on the state salary estimates and our institutional experience, the automated approach could yield estimated net savings of $2850 in the first year and $9560 over 3 years.

Conclusions

Automated reminders improved evaluation completion but did not improve timeliness of completion, which may not translate into meaningful formative benefits if feedback is delayed. Further studies should focus on the impact on cognitive burden and evaluation quality before large‐scale automated systems can be optimized and sustainably integrated into medical education.

Autor:innen und Institutionen

  • Department of Emergency Medicine Thomas Jefferson University Philadelphia Pennsylvania USA.
  • Sidney Kimmel Medical College Philadelphia Pennsylvania USA.
  • Department of Internal Medicine Thomas Jefferson University Philadelphia Pennsylvania USA.

ORCID-Profile: Chaiya Laoteppitaks, Jason Gonzalez, Nina Mingioni, Xiao Chi Zhang

Zitieren

APA

Laoteppitaks, C., Agarwal, A., Gonzalez, J., Mingioni, N., & Zhang, X. C. (2026). Using an Automated Evaluation System to Improve Medical Student Evaluation Response Rate and Reduce Administrative Burden. AEM Education and Training, 10(5). https://doi.org/10.1002/aet2.70257

Vancouver

Laoteppitaks C, Agarwal A, Gonzalez J, Mingioni N, Zhang XC. Using an Automated Evaluation System to Improve Medical Student Evaluation Response Rate and Reduce Administrative Burden. AEM Education and Training. 2026;10(5). doi:10.1002/aet2.70257

BibTeX
@article{Laoteppitaks2026,
  author = {Laoteppitaks, Chaiya and Agarwal, Alisha and Gonzalez, Jason and Mingioni, Nina and Zhang, Xiao Chi},
  title = {Using an Automated Evaluation System to Improve Medical Student Evaluation Response Rate and Reduce Administrative Burden},
  journal = {AEM Education and Training},
  year = {2026},
  volume = {10},
  number = {5},
  doi = {10.1002/aet2.70257}
}
Kostenlos starten →