EUVIMEDEUVIMED entdecken
Vergleichsstudie

Artificial Intelligence in the Trauma Bay: A Pilot Comparison With Surgical Trainees

Shivam Pandya iD, Marco Romo, Tamir Bresler, Corey Burrough, Roya Gheissari, Timothy Ko, Austen Mauch, Tiffany Calero, Marissa DeFreese

The American Surgeon™ · 2026

DOI: 10.1177/00031348261448897 ↗

Kurz gefasst

Vergleichsstudie in der Zeitschrift The American Surgeon™, 2026. Verfasst von Shivam Pandya und 8 weiteren Autor:innen. Beteiligte Einrichtung: Department of Surgery, Los Robles Regional Medical Center, Thousand Oaks, CA, USA. Hauptthemen laut MEDLINE: Internship and Residency, General Surgery, Traumatology, Artificial Intelligence. Die Arbeit nennt 15 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Large language models (LLMs) have demonstrated strong performance on general medical knowledge assessments; however, their accuracy within high-acuity, guideline-driven surgical environments such as the trauma bay remains incompletely characterized.

Objective

To compare the accuracy of a contemporary LLM, Google Gemini, with junior general surgery residents on trauma knowledge questions derived from national practice management guidelines.

Methods

Thirty multiple-choice questions were developed from current trauma guidelines issued by nationally recognized professional organizations and independently validated by faculty trauma surgeons. Six junior general surgery residents (PGY-1-2) completed the assessment, generating 180 total responses. The LLM was tested on the same questions under standardized conditions. Accuracy was calculated with 95% confidence intervals and compared using a two-proportion z-test.

Results

Residents answered 157 of 180 questions correctly (87.2%, 95% CI 81.6-91.3). The LLM answered 27 of 30 questions correctly (90.0%, 95% CI 74.4-96.5). There was no statistically significant difference in accuracy between groups ( P = .67).

Conclusion

In this pilot study, a LLM demonstrated accuracy comparable to junior surgical residents when evaluated on trauma guideline–based questions. Although no significant difference was found, the findings of our exploratory study support cautious exploration of guideline-grounded artificial intelligence as an adjunct in surgical education while underscoring the need for broader validation. Further power studies are required to confirm these preliminary findings.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Internship and ResidencyGeneral SurgeryTraumatologyArtificial IntelligenceClinical CompetencePilot ProjectsHumansLarge Language ModelsPractice Guidelines as TopicEducational Measurement

Stichwörter der Autor:innen

LLMsartificial intelligenceclinical practice guidelinessurgical educationtrauma surgery

Autor:innen und Institutionen

  • Department of Surgery, Los Robles Regional Medical Center, Thousand Oaks, CA, USA.

ORCID-Profile: Shivam Pandya

Zitieren

APA

Pandya, S., Romo, M., Bresler, T., Burrough, C., Gheissari, R., Ko, T., Mauch, A., Calero, T., & DeFreese, M. (2026). Artificial Intelligence in the Trauma Bay: A Pilot Comparison With Surgical Trainees. The American Surgeon™. https://doi.org/10.1177/00031348261448897

Vancouver

Pandya S, Romo M, Bresler T, Burrough C, Gheissari R, Ko T, et al. Artificial Intelligence in the Trauma Bay: A Pilot Comparison With Surgical Trainees. The American Surgeon™. 2026. doi:10.1177/00031348261448897

BibTeX
@article{Pandya2026,
  author = {Pandya, Shivam and Romo, Marco and Bresler, Tamir and Burrough, Corey and Gheissari, Roya and Ko, Timothy and Mauch, Austen and Calero, Tiffany and DeFreese, Marissa},
  title = {Artificial Intelligence in the Trauma Bay: A Pilot Comparison With Surgical Trainees},
  journal = {The American Surgeon™},
  year = {2026},
  doi = {10.1177/00031348261448897}
}
Kostenlos starten →