Surgeon, Trainee, or GPT ? A Blinded Multicentric Study of AI ‐Augmented Operative Notes
The Laryngoscope · 2026-02 · 136 (2) · 605-615
DOI: 10.1002/lary.70063 ↗Kurz gefasst
Multizentrische Studie in der Zeitschrift The Laryngoscope, online erschienen am 20.08.2025. Verfasst von Sholem Hack und 14 weiteren Autor:innen. Beteiligte Einrichtung: City St. George's University of London, School of Medicine, Program Delivered by University of Nicosia at the Chaim Sheba Medical Center, Ramat Gan, …. Hauptthemen laut MEDLINE: Documentation, Otolaryngology, Surgeons. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 45 Literaturangaben.
Abstract (Originalsprache)
Objectives
Clear, complete operative documentation is essential for surgical safety, continuity of care, and medico‐legal standards. Large language models such as ChatGPT offer promise for automating clinical documentation; however, their performance in operative note generation, particularly in surgical subspecialties, remains underexplored. This study aimed to compare the quality, accuracy, and efficiency of operative notes authored by a surgical resident, attending surgeon, GPT alone, and an attending surgeon using GPT as a writing aid.
Methods
Five publicly available otolaryngologic procedures were selected. For each procedure, four operative notes were generated, one by a resident, one by an attending, one by GPT alone, and one by a hybrid of attending plus GPT. Ten blinded otolaryngologists (five residents, five attendings) independently reviewed all 20 notes. Reviewers scored each note across eight domains using a five‐point scale, assigned a final approval rating, and provided qualitative feedback. Writing time was recorded to assess documentation efficiency.
Results
Hybrid notes written by an attending surgeon with GPT assistance received the highest average domain scores and the highest “as is” approval rate (79%), outperforming all other groups. GPT‐only notes were the fastest to generate but had the lowest approval rate (23%) and the highest incidence of both omissions and overdocumentation. Writing time was significantly reduced in both AI‐assisted groups compared to human‐only authorship. Inter‐rater reliability among reviewers was moderate to high across most domains.
Conclusion
In this limited dataset, hybrid human–AI collaboration outperformed both human‐only and AI‐only authorship in operative documentation. These findings support GPT‐assisted documentation to improve operative note efficiency and consistency. Level of Evidence N/A.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- City St. George's University of London, School of Medicine, Program Delivered by University of Nicosia at the Chaim Sheba Medical Center, Ramat Gan, Israel.
- Otolaryngology Unit, Santi Paolo E Carlo Hospital, Department of Health Sciences, Università Degli Studi Di Milano, Milan, Italy.
- Department of Otolaryngology, Sheffield Teaching Hospitals, Sheffield, UK.
- ENT Department, Royal Hallamshire Hospital, Sheffield, UK.
- Department of Medicine and Surgery, University of Enna "Kore", Enna, Italy.
- Department of Medical and Surgical Sciences and Advanced Technologies "G.F. Ingrassia", ENT Section, University of Catania, Catania, Italy.
ORCID-Profile: Sholem Hack, Antonino Maniaci, Carlos Miguel Chiesa-Estomba
Zitieren
APA
Hack, S., Attal, R., Locatelli, G., Scotta, G., Maniaci, A., Parisi, F. M., van der Poel, N., Van Daele, M., Garcia-Lliberos, A., Rodriguez-Prado, C., Chiesa-Estomba, C. M., Andueza-Guembe, M., Cobb, P., Zalzal, H. G., & Saibene, A. M. (2026). Surgeon, Trainee, or GPT ? A Blinded Multicentric Study of AI ‐Augmented Operative Notes. The Laryngoscope, 136(2), 605-615. https://doi.org/10.1002/lary.70063
Vancouver
Hack S, Attal R, Locatelli G, Scotta G, Maniaci A, Parisi FM, et al. Surgeon, Trainee, or GPT ? A Blinded Multicentric Study of AI ‐Augmented Operative Notes. The Laryngoscope. 2026;136(2):605-615. doi:10.1002/lary.70063
BibTeX
@article{Hack2026,
author = {Hack, Sholem and Attal, Rebecca and Locatelli, Giacomo and Scotta, Gianluca and Maniaci, Antonino and Parisi, Federica Maria and van der Poel, Nicolien and Van Daele, Margot and Garcia-Lliberos, Ainhoa and Rodriguez-Prado, Cristina and Chiesa-Estomba, Carlos Miguel and Andueza-Guembe, Maider and Cobb, Pollara and Zalzal, Habib G and Saibene, Alberto Maria},
title = {Surgeon, Trainee, or GPT ? A Blinded Multicentric Study of AI ‐Augmented Operative Notes},
journal = {The Laryngoscope},
year = {2026},
volume = {136},
number = {2},
pages = {605--615},
doi = {10.1002/lary.70063}
}
EUVIMED