EUVIMEDEUVIMED entdecken
Multizentrische StudieVergleichsstudie

Surgeon, Trainee, or GPT ? A Blinded Multicentric Study of AI ‐Augmented Operative Notes

Sholem Hack iD, Rebecca Attal, Giacomo Locatelli, Gianluca Scotta, Antonino Maniaci iD, Federica Maria Parisi, Nicolien van der Poel, Margot Van Daele, Ainhoa Garcia-Lliberos, Cristina Rodriguez-Prado, Carlos Miguel Chiesa-Estomba iD, Maider Andueza-Guembe und 3 weitere

The Laryngoscope · 2026-02 · 136 (2) · 605-615

DOI: 10.1002/lary.70063 ↗

Kurz gefasst

Multizentrische Studie in der Zeitschrift The Laryngoscope, online erschienen am 20.08.2025. Verfasst von Sholem Hack und 14 weiteren Autor:innen. Beteiligte Einrichtung: City St. George's University of London, School of Medicine, Program Delivered by University of Nicosia at the Chaim Sheba Medical Center, Ramat Gan, …. Hauptthemen laut MEDLINE: Documentation, Otolaryngology, Surgeons. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 45 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Objectives

Clear, complete operative documentation is essential for surgical safety, continuity of care, and medico‐legal standards. Large language models such as ChatGPT offer promise for automating clinical documentation; however, their performance in operative note generation, particularly in surgical subspecialties, remains underexplored. This study aimed to compare the quality, accuracy, and efficiency of operative notes authored by a surgical resident, attending surgeon, GPT alone, and an attending surgeon using GPT as a writing aid.

Methods

Five publicly available otolaryngologic procedures were selected. For each procedure, four operative notes were generated, one by a resident, one by an attending, one by GPT alone, and one by a hybrid of attending plus GPT. Ten blinded otolaryngologists (five residents, five attendings) independently reviewed all 20 notes. Reviewers scored each note across eight domains using a five‐point scale, assigned a final approval rating, and provided qualitative feedback. Writing time was recorded to assess documentation efficiency.

Results

Hybrid notes written by an attending surgeon with GPT assistance received the highest average domain scores and the highest “as is” approval rate (79%), outperforming all other groups. GPT‐only notes were the fastest to generate but had the lowest approval rate (23%) and the highest incidence of both omissions and overdocumentation. Writing time was significantly reduced in both AI‐assisted groups compared to human‐only authorship. Inter‐rater reliability among reviewers was moderate to high across most domains.

Conclusion

In this limited dataset, hybrid human–AI collaboration outperformed both human‐only and AI‐only authorship in operative documentation. These findings support GPT‐assisted documentation to improve operative note efficiency and consistency. Level of Evidence N/A.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

DocumentationOtolaryngologySurgeonsHumansInternship and Residency

Stichwörter der Autor:innen

GPT‐4.0artificial intelligenceclinical note qualitylarge language modelsoperative documentationotolaryngologysurgical workflow

Autor:innen und Institutionen

  • City St. George's University of London, School of Medicine, Program Delivered by University of Nicosia at the Chaim Sheba Medical Center, Ramat Gan, Israel.
  • Otolaryngology Unit, Santi Paolo E Carlo Hospital, Department of Health Sciences, Università Degli Studi Di Milano, Milan, Italy.
  • Department of Otolaryngology, Sheffield Teaching Hospitals, Sheffield, UK.
  • ENT Department, Royal Hallamshire Hospital, Sheffield, UK.
  • Department of Medicine and Surgery, University of Enna "Kore", Enna, Italy.
  • Department of Medical and Surgical Sciences and Advanced Technologies "G.F. Ingrassia", ENT Section, University of Catania, Catania, Italy.

ORCID-Profile: Sholem Hack, Antonino Maniaci, Carlos Miguel Chiesa-Estomba

Zitieren

APA

Hack, S., Attal, R., Locatelli, G., Scotta, G., Maniaci, A., Parisi, F. M., van der Poel, N., Van Daele, M., Garcia-Lliberos, A., Rodriguez-Prado, C., Chiesa-Estomba, C. M., Andueza-Guembe, M., Cobb, P., Zalzal, H. G., & Saibene, A. M. (2026). Surgeon, Trainee, or GPT ? A Blinded Multicentric Study of AI ‐Augmented Operative Notes. The Laryngoscope, 136(2), 605-615. https://doi.org/10.1002/lary.70063

Vancouver

Hack S, Attal R, Locatelli G, Scotta G, Maniaci A, Parisi FM, et al. Surgeon, Trainee, or GPT ? A Blinded Multicentric Study of AI ‐Augmented Operative Notes. The Laryngoscope. 2026;136(2):605-615. doi:10.1002/lary.70063

BibTeX
@article{Hack2026,
  author = {Hack, Sholem and Attal, Rebecca and Locatelli, Giacomo and Scotta, Gianluca and Maniaci, Antonino and Parisi, Federica Maria and van der Poel, Nicolien and Van Daele, Margot and Garcia-Lliberos, Ainhoa and Rodriguez-Prado, Cristina and Chiesa-Estomba, Carlos Miguel and Andueza-Guembe, Maider and Cobb, Pollara and Zalzal, Habib G and Saibene, Alberto Maria},
  title = {Surgeon, Trainee, or GPT ? A Blinded Multicentric Study of AI ‐Augmented Operative Notes},
  journal = {The Laryngoscope},
  year = {2026},
  volume = {136},
  number = {2},
  pages = {605--615},
  doi = {10.1002/lary.70063}
}
Kostenlos starten →