EUVIMEDEUVIMED entdecken
Open Access

Applying Large Language Models for Surgical Case Length Prediction

Adhitya Ramamurthi, Bhabishya Neupane, Priya Deshpande, Ryan Hanson, Srujan Vegesna, Deborah Cray, Bradley H Crotty, Melek Somai, Kellie R Brown, Sachin S Pawar, Bradley Taylor, Anai N Kothari

JAMA Surgery · 01.08.2025 · 160 (8) · 894

DOI: 10.1001/jamasurg.2025.2154 ↗

Kurz gefasst

Fachartikel in der Zeitschrift JAMA Surgery, erschienen am 01.08.2025. Verfasst von Adhitya Ramamurthi und 11 weiteren Autor:innen. Beteiligte Einrichtung: Selig Hub for Surgical Data Science, Medical College of Wisconsin, Milwaukee. Hauptthemen laut MEDLINE: Operative Time, Operating Rooms, Elective Surgical Procedures. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 26 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Importance Accurate prediction of surgical case duration is critical for operating room (OR) management, as inefficient scheduling can lead to reduced patient and surgeon satisfaction while incurring considerable financial costs.

Objective

To evaluate the feasibility and accuracy of large language models (LLMs) in predicting surgical case length using unstructured clinical data compared to existing estimation methods. Design, Setting, and Participants This was a retrospective study analyzing elective surgical cases performed between January 2017 and December 2023 at a single academic medical center and affiliated community hospital ORs. Analysis included 125 493 eligible surgical cases, with 1950 used for LLM fine-tuning and 2500 for evaluation. An additional 500 cases from a community site were used for external validation. Cases were randomly sampled using strata to ensure representation across surgical specialties. Exposures Eleven LLMs, including base models (GPT-4, GPT-3.5, Mistral, Llama-3, Phi-3) and 2 fine-tuned variants (GPT-4 fine-tuned, GPT-3.5 fine-tuned), were used to predict surgical case length based on clinical notes. Main Outcomes and Measures The primary outcome was average error between predicted and actual surgical case length (wheels-in to wheels-out time). The secondary outcome was prediction accuracy, defined as predicted length within 20% of actual duration.

Results

Fine-tuned GPT-4 achieved the best performance with a mean absolute error (MAE) of 47.64 minutes (95% CI, 45.71-49.56) and R 2 of 0.61, matching the performance of current OR scheduling (MAE, 49.34 minutes; 95% CI, 47.60-51.09; R 2 , 0.63; P = .10). Both GPT-4 fine-tuned and GPT-3.5 fine-tuned significantly outperformed current scheduling methods in accuracy (46.12% and 46.08% vs 40.92%, respectively; P < .001). GPT-4 fine-tuned outperformed all other models during external validation with similar performance metrics (MAE, 48.66 minutes; 95% CI, 45.31-52.00; accuracy, 46.0%). Base models demonstrated variable performance, with GPT-4 showing the highest performance among non–fine-tuned models (MAE, 59.20 minutes; 95% CI, 56.88 - 61.52). Conclusion and Relevance The findings in this study suggest that fine-tuned LLMs can predict surgical case length with accuracy comparable to or exceeding current institutional scheduling methods. This indicates potential for LLMs to enhance operating room efficiency through improved case length prediction using existing clinical documentation.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Operative TimeOperating RoomsElective Surgical ProceduresHumansRetrospective StudiesFemaleMaleMiddle AgedFeasibility StudiesLarge Language Models

Autor:innen und Institutionen

  • Selig Hub for Surgical Data Science, Medical College of Wisconsin, Milwaukee.
  • Department of Surgery, Medical College of Wisconsin, Milwaukee.
  • Clinical and Translational Science Institute, Medical College of Wisconsin, Milwaukee.
  • Department of Electrical and Computer Engineering, Marquette University, Milwaukee, Wisconsin.
  • Froedtert Hospital, Milwaukee, Wisconsin.
  • Inception Health Labs, Medical College of Wisconsin, Milwaukee.

Zitieren

APA

Ramamurthi, A., Neupane, B., Deshpande, P., Hanson, R., Vegesna, S., Cray, D., Crotty, B. H., Somai, M., Brown, K. R., Pawar, S. S., Taylor, B., & Kothari, A. N. (2025). Applying Large Language Models for Surgical Case Length Prediction. JAMA Surgery, 160(8), 894. https://doi.org/10.1001/jamasurg.2025.2154

Vancouver

Ramamurthi A, Neupane B, Deshpande P, Hanson R, Vegesna S, Cray D, et al. Applying Large Language Models for Surgical Case Length Prediction. JAMA Surgery. 2025;160(8):894. doi:10.1001/jamasurg.2025.2154

BibTeX
@article{Ramamurthi2025,
  author = {Ramamurthi, Adhitya and Neupane, Bhabishya and Deshpande, Priya and Hanson, Ryan and Vegesna, Srujan and Cray, Deborah and Crotty, Bradley H and Somai, Melek and Brown, Kellie R and Pawar, Sachin S and Taylor, Bradley and Kothari, Anai N},
  title = {Applying Large Language Models for Surgical Case Length Prediction},
  journal = {JAMA Surgery},
  year = {2025},
  volume = {160},
  number = {8},
  pages = {894},
  doi = {10.1001/jamasurg.2025.2154}
}
Kostenlos starten →