Artificial Intelligence in the Trauma Bay: A Pilot Comparison With Surgical Trainees
The American Surgeon™ · 2026
DOI: 10.1177/00031348261448897 ↗Kurz gefasst
Vergleichsstudie in der Zeitschrift The American Surgeon™, 2026. Verfasst von Shivam Pandya und 8 weiteren Autor:innen. Beteiligte Einrichtung: Department of Surgery, Los Robles Regional Medical Center, Thousand Oaks, CA, USA. Hauptthemen laut MEDLINE: Internship and Residency, General Surgery, Traumatology, Artificial Intelligence. Die Arbeit nennt 15 Literaturangaben.
Abstract (Originalsprache)
Background
Large language models (LLMs) have demonstrated strong performance on general medical knowledge assessments; however, their accuracy within high-acuity, guideline-driven surgical environments such as the trauma bay remains incompletely characterized.
Objective
To compare the accuracy of a contemporary LLM, Google Gemini, with junior general surgery residents on trauma knowledge questions derived from national practice management guidelines.
Methods
Thirty multiple-choice questions were developed from current trauma guidelines issued by nationally recognized professional organizations and independently validated by faculty trauma surgeons. Six junior general surgery residents (PGY-1-2) completed the assessment, generating 180 total responses. The LLM was tested on the same questions under standardized conditions. Accuracy was calculated with 95% confidence intervals and compared using a two-proportion z-test.
Results
Residents answered 157 of 180 questions correctly (87.2%, 95% CI 81.6-91.3). The LLM answered 27 of 30 questions correctly (90.0%, 95% CI 74.4-96.5). There was no statistically significant difference in accuracy between groups ( P = .67).
Conclusion
In this pilot study, a LLM demonstrated accuracy comparable to junior surgical residents when evaluated on trauma guideline–based questions. Although no significant difference was found, the findings of our exploratory study support cautious exploration of guideline-grounded artificial intelligence as an adjunct in surgical education while underscoring the need for broader validation. Further power studies are required to confirm these preliminary findings.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Surgery, Los Robles Regional Medical Center, Thousand Oaks, CA, USA.
ORCID-Profile: Shivam Pandya
Zitieren
APA
Pandya, S., Romo, M., Bresler, T., Burrough, C., Gheissari, R., Ko, T., Mauch, A., Calero, T., & DeFreese, M. (2026). Artificial Intelligence in the Trauma Bay: A Pilot Comparison With Surgical Trainees. The American Surgeon™. https://doi.org/10.1177/00031348261448897
Vancouver
Pandya S, Romo M, Bresler T, Burrough C, Gheissari R, Ko T, et al. Artificial Intelligence in the Trauma Bay: A Pilot Comparison With Surgical Trainees. The American Surgeon™. 2026. doi:10.1177/00031348261448897
BibTeX
@article{Pandya2026,
author = {Pandya, Shivam and Romo, Marco and Bresler, Tamir and Burrough, Corey and Gheissari, Roya and Ko, Timothy and Mauch, Austen and Calero, Tiffany and DeFreese, Marissa},
title = {Artificial Intelligence in the Trauma Bay: A Pilot Comparison With Surgical Trainees},
journal = {The American Surgeon™},
year = {2026},
doi = {10.1177/00031348261448897}
}
EUVIMED