EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Feasibility of LLM-Assisted Communication Feedback in Simulation-Based Medical Education: A Pilot Study

Mohamed Alhaskir, Hannah Haven, Michael Langer, Tim Peters, Miriam Hertwig, Jenny Unterkofler, Christopher Plata, Simon Ostermann, Yannik Haven, Kai O Hensel, Jonas Bienzeisler

Studies in Health Technology and Informatics · 21.05.2026

DOI: 10.3233/shti260639 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Studies in Health Technology and Informatics, erschienen am 21.05.2026. Verfasst von Mohamed Alhaskir und 10 weiteren Autor:innen. Beteiligte Einrichtung: Institute of Med. Informatics, Medical Faculty of RWTH Aachen University, Germany. Hauptthemen laut MEDLINE: Large Language Models, Communication, Education, Medical, Formative Feedback. Die Arbeit wurde bisher 2-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The study presents a local large language model pipeline for automated feedback in pediatric simulation-based medical education. The system generates structured reports using the Liverpool Undergraduate Communication Assessment Scale. Four communication simulations were processed and evaluated against human feedback. The model generated structured reports with total scores (mean = 13.9 ± 1.2) comparable to human ratings (mean = 12.8 ± 2.9). Scenario-level analyses indicated variation in some cases but overall reliable performance across simulation runs. The pipeline demonstrated lower inter-rater variability (SD = 0.7–1.7) than human examiners (SD = 1.3–2.9), indicating greater internal consistency. The findings inform a forthcoming prospective evaluation.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Large Language ModelsCommunicationEducation, MedicalFormative FeedbackPediatricsSimulation TrainingPilot ProjectsHumansFeasibility StudiesEducational Measurement

Stichwörter der Autor:innen

Artificial IntelligenceAutomated FeedbackCommunication SkillsLarge Language ModelsMedical Educationsimulation-based learning

Autor:innen und Institutionen

  • Institute of Med. Informatics, Medical Faculty of RWTH Aachen University, Germany.
  • Department of Paediatrics, University Hospital Wuppertal, Wuppertal, Germany.
  • Faculty of Health, Witten/Herdecke University, Witten, Germany.
  • Paramedic Academy Fire Department Wuppertal Germany.
  • Bielefeld University, Medical School OWL, Department of General Practice and Family Medicine, Department of Studies and Teaching, Bielefeld, Germany.
  • Centre for Clinical Acute- and Emergency Med., Univ. Hospital RWHT Aachen, Germany.

Zitieren

APA

Alhaskir, M., Haven, H., Langer, M., Peters, T., Hertwig, M., Unterkofler, J., Plata, C., Ostermann, S., Haven, Y., Hensel, K. O., & Bienzeisler, J. (2026). Feasibility of LLM-Assisted Communication Feedback in Simulation-Based Medical Education: A Pilot Study. Studies in Health Technology and Informatics. https://doi.org/10.3233/shti260639

Vancouver

Alhaskir M, Haven H, Langer M, Peters T, Hertwig M, Unterkofler J, et al. Feasibility of LLM-Assisted Communication Feedback in Simulation-Based Medical Education: A Pilot Study. Studies in Health Technology and Informatics. 2026. doi:10.3233/shti260639

BibTeX
@article{Alhaskir2026,
  author = {Alhaskir, Mohamed and Haven, Hannah and Langer, Michael and Peters, Tim and Hertwig, Miriam and Unterkofler, Jenny and Plata, Christopher and Ostermann, Simon and Haven, Yannik and Hensel, Kai O and Bienzeisler, Jonas},
  title = {Feasibility of LLM-Assisted Communication Feedback in Simulation-Based Medical Education: A Pilot Study},
  journal = {Studies in Health Technology and Informatics},
  year = {2026},
  doi = {10.3233/shti260639}
}
Kostenlos starten →