Feasibility of LLM-Assisted Communication Feedback in Simulation-Based Medical Education: A Pilot Study
Studies in Health Technology and Informatics · 21.05.2026
DOI: 10.3233/shti260639 ↗Kurz gefasst
Fachartikel in der Zeitschrift Studies in Health Technology and Informatics, erschienen am 21.05.2026. Verfasst von Mohamed Alhaskir und 10 weiteren Autor:innen. Beteiligte Einrichtung: Institute of Med. Informatics, Medical Faculty of RWTH Aachen University, Germany. Hauptthemen laut MEDLINE: Large Language Models, Communication, Education, Medical, Formative Feedback. Die Arbeit wurde bisher 2-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
The study presents a local large language model pipeline for automated feedback in pediatric simulation-based medical education. The system generates structured reports using the Liverpool Undergraduate Communication Assessment Scale. Four communication simulations were processed and evaluated against human feedback. The model generated structured reports with total scores (mean = 13.9 ± 1.2) comparable to human ratings (mean = 12.8 ± 2.9). Scenario-level analyses indicated variation in some cases but overall reliable performance across simulation runs. The pipeline demonstrated lower inter-rater variability (SD = 0.7–1.7) than human examiners (SD = 1.3–2.9), indicating greater internal consistency. The findings inform a forthcoming prospective evaluation.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Institute of Med. Informatics, Medical Faculty of RWTH Aachen University, Germany.
- Department of Paediatrics, University Hospital Wuppertal, Wuppertal, Germany.
- Faculty of Health, Witten/Herdecke University, Witten, Germany.
- Paramedic Academy Fire Department Wuppertal Germany.
- Bielefeld University, Medical School OWL, Department of General Practice and Family Medicine, Department of Studies and Teaching, Bielefeld, Germany.
- Centre for Clinical Acute- and Emergency Med., Univ. Hospital RWHT Aachen, Germany.
Zitieren
APA
Alhaskir, M., Haven, H., Langer, M., Peters, T., Hertwig, M., Unterkofler, J., Plata, C., Ostermann, S., Haven, Y., Hensel, K. O., & Bienzeisler, J. (2026). Feasibility of LLM-Assisted Communication Feedback in Simulation-Based Medical Education: A Pilot Study. Studies in Health Technology and Informatics. https://doi.org/10.3233/shti260639
Vancouver
Alhaskir M, Haven H, Langer M, Peters T, Hertwig M, Unterkofler J, et al. Feasibility of LLM-Assisted Communication Feedback in Simulation-Based Medical Education: A Pilot Study. Studies in Health Technology and Informatics. 2026. doi:10.3233/shti260639
BibTeX
@article{Alhaskir2026,
author = {Alhaskir, Mohamed and Haven, Hannah and Langer, Michael and Peters, Tim and Hertwig, Miriam and Unterkofler, Jenny and Plata, Christopher and Ostermann, Simon and Haven, Yannik and Hensel, Kai O and Bienzeisler, Jonas},
title = {Feasibility of LLM-Assisted Communication Feedback in Simulation-Based Medical Education: A Pilot Study},
journal = {Studies in Health Technology and Informatics},
year = {2026},
doi = {10.3233/shti260639}
}
EUVIMED