EUVIMEDOpdag EUVIMED
Randomisierte kontrollierte StudieOpen access

Ambient AI Scribes to Create Educational Feedback Notes for Medical Students: Randomized Trial

Jaideep S Talwalkar iD, David Chartash iD, Lisa Zhang iD, Michael Makutonin iD, Conrad W Safranek iD, Anne Elizabeth Sidamon-Eristoff iD, Lee H Schwamm iD, Donald S Wright iD

JMIR Medical Education · 2026-05-28 · 12 · e89996-e89996

DOI: 10.2196/89996 ↗

At a glance

Randomisierte kontrollierte Studie in JMIR Medical Education, published online on 2026-05-28. Written by Jaideep S Talwalkar and 7 co-authors. Institution: Departments of Medicine and Pediatrics, Yale School of Medicine, 367 Cedar Street, Bldg D, New Haven, CT, 06510, United States, 1 203-737-4190, 1 203…. Major MEDLINE topics: Artificial Intelligence, Students, Medical, Documentation, Feedback. Cited 4 times so far (Crossref); 32 references. The full text is freely available in PubMed Central.

AbstractSubjectsBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Background

High-quality observation and feedback contribute to the development of clinical competence and professional growth in medical education. Faculty often struggle to translate verbal observations into written feedback because of documentation burden and competing demands. Ambient artificial intelligence (AI) scribes, already adopted in clinical practice, may address this challenge by capturing verbal exchanges and generating structured notes.

Objective

The purpose of this study was to examine the use of ambient AI scribes to generate educational feedback notes during a formative medical interviewing workshop for first-year medical students in March and April 2025.

Methods

Thirteen instructors were randomized to control (human-only) or intervention (AI scribe–assisted) workflows to complete narrative feedback forms. The intervention group used an AI scribe to generate transcripts of student-instructor encounters, which were then summarized into feedback notes using a large language model and edited by the instructors before submission. All narratives were scored using the Evaluation of Feedback Captured Tool (EFeCT). Factual accuracy of a subsample of unedited AI feedback summaries was reviewed against the source transcripts. Task load and usability were measured using NASA Task Load Index and System Usability Scale, respectively.

Results

Instructors submitted feedback on 92.2% (94/102) of the students. EFeCT scores on the scale from 0 to 5 were higher for human-edited AI narratives (median 3.00, IQR 2.00-4.00) and unedited AI summaries (median 3.00, IQR 3.00-4.00) than for human-only narratives (median 2.00, IQR 1.75-3.00; P

Subjects

MeSH terms (MEDLINE)

Artificial IntelligenceStudents, MedicalDocumentationFeedbackFormative FeedbackHumansEducational MeasurementFemaleMale

Author keywords

AIambient scribeartificial intelligencecompetency-based educationfeedbackformative assessmentmedical student education

Authors and institutions

  • Departments of Medicine and Pediatrics, Yale School of Medicine, 367 Cedar Street, Bldg D, New Haven, CT, 06510, United States, 1 203-737-4190, 1 203-737-4199.
  • Department of Emergency Medicine, Yale School of Medicine, New Haven, CT, United States.
  • Yale School of Medicine, New Haven, CT, United States.
  • Departments of Neurology and Biomedical Informatics and Data Sciences, Yale School of Medicine, New Haven, CT, United States.
  • Department of Veterans Affairs, Connecticut VA Healthcare System, West Haven, CT, United States.

ORCID profiles: Jaideep S Talwalkar, David Chartash, Lisa Zhang, Michael Makutonin, Conrad W Safranek, Anne Elizabeth Sidamon-Eristoff, Lee H Schwamm, Donald S Wright

Cite

APA

Talwalkar, J. S., Chartash, D., Zhang, L., Makutonin, M., Safranek, C. W., Sidamon-Eristoff, A. E., Schwamm, L. H., & Wright, D. S. (2026). Ambient AI Scribes to Create Educational Feedback Notes for Medical Students: Randomized Trial. JMIR Medical Education, 12, e89996-e89996. https://doi.org/10.2196/89996

Vancouver

Talwalkar JS, Chartash D, Zhang L, Makutonin M, Safranek CW, Sidamon-Eristoff AE, et al. Ambient AI Scribes to Create Educational Feedback Notes for Medical Students: Randomized Trial. JMIR Medical Education. 2026;12:e89996-e89996. doi:10.2196/89996

BibTeX
@article{Talwalkar2026,
  author = {Talwalkar, Jaideep S and Chartash, David and Zhang, Lisa and Makutonin, Michael and Safranek, Conrad W and Sidamon-Eristoff, Anne Elizabeth and Schwamm, Lee H and Wright, Donald S},
  title = {Ambient AI Scribes to Create Educational Feedback Notes for Medical Students: Randomized Trial},
  journal = {JMIR Medical Education},
  year = {2026},
  volume = {12},
  pages = {e89996--e89996},
  doi = {10.2196/89996}
}
Start for free →