Applying Large Language Models for Surgical Case Length Prediction
JAMA Surgery · 01.08.2025 · 160 (8) · 894
DOI: 10.1001/jamasurg.2025.2154 ↗Kurz gefasst
Fachartikel in der Zeitschrift JAMA Surgery, erschienen am 01.08.2025. Verfasst von Adhitya Ramamurthi und 11 weiteren Autor:innen. Beteiligte Einrichtung: Selig Hub for Surgical Data Science, Medical College of Wisconsin, Milwaukee. Hauptthemen laut MEDLINE: Operative Time, Operating Rooms, Elective Surgical Procedures. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 26 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Importance Accurate prediction of surgical case duration is critical for operating room (OR) management, as inefficient scheduling can lead to reduced patient and surgeon satisfaction while incurring considerable financial costs.
Objective
To evaluate the feasibility and accuracy of large language models (LLMs) in predicting surgical case length using unstructured clinical data compared to existing estimation methods. Design, Setting, and Participants This was a retrospective study analyzing elective surgical cases performed between January 2017 and December 2023 at a single academic medical center and affiliated community hospital ORs. Analysis included 125 493 eligible surgical cases, with 1950 used for LLM fine-tuning and 2500 for evaluation. An additional 500 cases from a community site were used for external validation. Cases were randomly sampled using strata to ensure representation across surgical specialties. Exposures Eleven LLMs, including base models (GPT-4, GPT-3.5, Mistral, Llama-3, Phi-3) and 2 fine-tuned variants (GPT-4 fine-tuned, GPT-3.5 fine-tuned), were used to predict surgical case length based on clinical notes. Main Outcomes and Measures The primary outcome was average error between predicted and actual surgical case length (wheels-in to wheels-out time). The secondary outcome was prediction accuracy, defined as predicted length within 20% of actual duration.
Results
Fine-tuned GPT-4 achieved the best performance with a mean absolute error (MAE) of 47.64 minutes (95% CI, 45.71-49.56) and R 2 of 0.61, matching the performance of current OR scheduling (MAE, 49.34 minutes; 95% CI, 47.60-51.09; R 2 , 0.63; P = .10). Both GPT-4 fine-tuned and GPT-3.5 fine-tuned significantly outperformed current scheduling methods in accuracy (46.12% and 46.08% vs 40.92%, respectively; P < .001). GPT-4 fine-tuned outperformed all other models during external validation with similar performance metrics (MAE, 48.66 minutes; 95% CI, 45.31-52.00; accuracy, 46.0%). Base models demonstrated variable performance, with GPT-4 showing the highest performance among non–fine-tuned models (MAE, 59.20 minutes; 95% CI, 56.88 - 61.52). Conclusion and Relevance The findings in this study suggest that fine-tuned LLMs can predict surgical case length with accuracy comparable to or exceeding current institutional scheduling methods. This indicates potential for LLMs to enhance operating room efficiency through improved case length prediction using existing clinical documentation.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Selig Hub for Surgical Data Science, Medical College of Wisconsin, Milwaukee.
- Department of Surgery, Medical College of Wisconsin, Milwaukee.
- Clinical and Translational Science Institute, Medical College of Wisconsin, Milwaukee.
- Department of Electrical and Computer Engineering, Marquette University, Milwaukee, Wisconsin.
- Froedtert Hospital, Milwaukee, Wisconsin.
- Inception Health Labs, Medical College of Wisconsin, Milwaukee.
Zitieren
APA
Ramamurthi, A., Neupane, B., Deshpande, P., Hanson, R., Vegesna, S., Cray, D., Crotty, B. H., Somai, M., Brown, K. R., Pawar, S. S., Taylor, B., & Kothari, A. N. (2025). Applying Large Language Models for Surgical Case Length Prediction. JAMA Surgery, 160(8), 894. https://doi.org/10.1001/jamasurg.2025.2154
Vancouver
Ramamurthi A, Neupane B, Deshpande P, Hanson R, Vegesna S, Cray D, et al. Applying Large Language Models for Surgical Case Length Prediction. JAMA Surgery. 2025;160(8):894. doi:10.1001/jamasurg.2025.2154
BibTeX
@article{Ramamurthi2025,
author = {Ramamurthi, Adhitya and Neupane, Bhabishya and Deshpande, Priya and Hanson, Ryan and Vegesna, Srujan and Cray, Deborah and Crotty, Bradley H and Somai, Melek and Brown, Kellie R and Pawar, Sachin S and Taylor, Bradley and Kothari, Anai N},
title = {Applying Large Language Models for Surgical Case Length Prediction},
journal = {JAMA Surgery},
year = {2025},
volume = {160},
number = {8},
pages = {894},
doi = {10.1001/jamasurg.2025.2154}
}
EUVIMED