Impact of Generative AI on Operative Planning in Otolaryngology Residents
Surgical Innovation · 2026-12 · 33 (6) · 576-588
DOI: 10.1177/15533506261446833 ↗Kurz gefasst
Fachartikel in der Zeitschrift Surgical Innovation, online erschienen am 29.04.2026. Verfasst von Sholem Hack und 7 weiteren Autor:innen. Beteiligte Einrichtung: City St. George's University of London, School of Medicine, Program Delivered By University of Nicosia at the Chaim Sheba Medical Center, Ramat Gan, …. Hauptthemen laut MEDLINE: Internship and Residency, Otolaryngology, Simulation Training. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 48 Literaturangaben.
Abstract (Originalsprache)
Purpose
To quantify how large language model (LLM) assistance influences otolaryngology residents’ operative planning in a simulation-based setting.
Methods
In a within-subjects paired design, 13 otolaryngology residents (PGY1-4) completed 21 synthetic surgical scenarios twice: first independently and then after reviewing a ChatGPT-5–generated plan produced using a fixed prompt. After AI review, residents recorded an ordinal ImpactScore (0-3: no change to major change) describing the magnitude of plan modification and rated usefulness (1-5 Likert). Paired analyses compared pre- vs post-AI changes in plan structure and narrative length across domains; mixed-effects models evaluated associations with PGY level and subspecialty.
Results
Across all 267 paired resident–case observations, AI altered operative plans in 91.0% (243/267; 95% CI, 87.2%–93.8%), with a mean ImpactScore of 1.32 ± 0.75 (median 1 [IQR 1-2]). Impact differed by PGY (H = 25.02; P = 1.53 × 10 −5 ), with PGY2 and PGY3 showing lower ImpactScores than PGY1 in mixed-effects modeling. Subspecialty differences were observed (H = 11.95; P = 0.036), with higher impact in sleep surgery than laryngology. After AI review, operative step descriptions shortened (mean −192.2 characters; P < 10 −40 ) and safety text shortened (−18.3 characters; P < 10 −22 ), while complication text modestly increased (+8.1 characters; P = 0.0039). Mean usefulness was 2.90 ± 1.10 and increased with ImpactScore (β = 0.264; P = 0.003).
Conclusion
In simulation-based operative planning, ChatGPT-5 frequently prompted residents to modify and reorganize operative plans, with effects varying by training level and case type. LLM assistance may function as a reflective structuring aid, but requires supervised use given occasional clinically concerning model suggestions.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- City St. George's University of London, School of Medicine, Program Delivered By University of Nicosia at the Chaim Sheba Medical Center, Ramat Gan, Israel.
- 1st Faculty of Medicine, Charles University in, Prague, Czech Republic.
- Washington University in St.Loius, St. Louis, MO, USA.
- Department of Otolaryngology, Sheba Medical Center, Ramat Gan, Israel.
- Gray Faculty of Medical & Health Sciences, Tel-Aviv University, Tel aviv, Israel.
- Department of Otolaryngology-Head and Neck Surgery, Houston Methodist Hospital, Houston, TX, USA.
ORCID-Profile: Sholem Hack
Zitieren
APA
Hack, S., Hayu, D., Karni, J. E., Glikson, E., Remer, E., Alon, E. E., Ahmed, O. G., & Takashima, M. (2026). Impact of Generative AI on Operative Planning in Otolaryngology Residents. Surgical Innovation, 33(6), 576-588. https://doi.org/10.1177/15533506261446833
Vancouver
Hack S, Hayu D, Karni JE, Glikson E, Remer E, Alon EE, et al. Impact of Generative AI on Operative Planning in Otolaryngology Residents. Surgical Innovation. 2026;33(6):576-588. doi:10.1177/15533506261446833
BibTeX
@article{Hack2026,
author = {Hack, Sholem and Hayu, Daor and Karni, Jacob E and Glikson, Eran and Remer, Eric and Alon, Eran E and Ahmed, Omar G and Takashima, Masayoshi},
title = {Impact of Generative AI on Operative Planning in Otolaryngology Residents},
journal = {Surgical Innovation},
year = {2026},
volume = {33},
number = {6},
pages = {576--588},
doi = {10.1177/15533506261446833}
}
EUVIMED