EUVIMEDEUVIMED entdecken
ValidierungsstudieOpen Access

Prediction of Postoperative Vomiting Within 24 Hours Using Machine Learning With Large Language Model–Enhanced Interpretability: Development and Validation Study

Huan-Jun Wang iD, Wei-Po Lee iD, Tz-Ping Gau iD, Kuang-I Cheng iD, Cheng-Ru Wei iD

JMIR Medical Informatics · 31.07.2026 · 14 · e84260-e84260

DOI: 10.2196/84260 ↗

Kurz gefasst

Validierungsstudie in der Zeitschrift JMIR Medical Informatics, online erschienen am 31.07.2026. Verfasst von Huan-Jun Wang und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Information Management, National Sun Yat-sen University, No. 70, Lianhai Rd., Gushan District, Kaohsiung 80424, Kaohsiung, Taiwan, 886 …. Hauptthemen laut MEDLINE: Postoperative Nausea and Vomiting, Machine Learning. Die Arbeit nennt 33 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Postoperative nausea and vomiting are common complications after anesthesia. However, vomiting represents a clinically distinct and objectively measurable endpoint.

Objective

This study aimed to develop and internally validate predictive models for postoperative vomiting within 24 hours using structured perioperative data and unstructured clinical text, while introducing a structured framework that separates feature construction from interpretability using large language models (LLMs).

Methods

We analyzed 33,460 anesthesia records from a single center (2019‐2022). Two temporally defined prediction tasks were constructed to reflect real-world clinical decision-making and prevent information leakage: a preoperative model using variables available before anesthesia induction, and a perioperative model using variables available up to the end of surgery. Structured data were modeled using machine learning algorithms (logistic regression, Extreme Gradient Boosting, Light Gradient Boosting Machine [LightGBM]). Unstructured clinical text was incorporated through a deterministic, concept-driven preprocessing pipeline, where LLMs were used solely for normalization (temperature=0) without feature generation, followed by rule-based concept mapping and feature encoding. Post hoc interpretability was further supported using an LLM-based Question Answering Chain module. Model performance was evaluated using receiver operating characteristic-area under the curve (AUC), precision-recall AUC, calibration metrics, and threshold-based operating characteristics. Classification thresholds were selected using the Youden J statistic, and all metrics were reported with 95% CIs derived from bootstrap resampling. Decision curve analysis was performed to assess clinical utility.

Results

A total of 33,460 surgical procedures were included, of which 3607 (10.8%) experienced postoperative vomiting within 24 hours. In the preoperative task, LightGBM achieved an AUC of 0.729 (95% CI 0.706‐0.749), compared with 0.610 (95% CI 0.588‐0.632) for the Apfel score. In the end-of-surgery task, LightGBM achieved an AUC of 0.735 (95% CI 0.714‐0.757). At the Youden-optimal threshold, the negative predictive value exceeded 0.95 across all models. Decision curve analysis demonstrated positive net benefit across clinically relevant threshold probabilities. Incorporating text-derived features provided modest improvements, while LLM-based explanation modules generated structured, natural-language explanations intended to enhance interpretability without substantially improving predictive performance.

Conclusions

Machine learning models can effectively predict postoperative vomiting within 24 hours using perioperative data. The proposed framework demonstrates that LLMs can be integrated in a controlled and reproducible manner—restricted to deterministic normalization and post hoc reasoning—to generate natural-language explanations intended to enhance the interpretability of model predictions, without introducing information leakage or altering predictive modeling. As no formal clinician-based evaluation was conducted, this interpretability benefit cannot yet be objectively confirmed, and the generated explanations should be regarded as a useful interpretability aid to be validated in future clinician-centered studies. External, multicenter validation is required before broader clinical applicability can be assumed.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Postoperative Nausea and VomitingMachine LearningHumansLarge Language ModelsPredictive Learning ModelsROC CurveBoosting Machine Learning AlgorithmsPrediction AlgorithmsClassification AlgorithmsArea Under Curve

Stichwörter der Autor:innen

SHAPShapley Additive Explanationsclinical decision supportclinical prediction modelelectronic health recordsinterpretabilitylarge language modelsmachine learningperioperative risk predictionpostoperative vomitingtemporal validation

Autor:innen und Institutionen

  • Department of Information Management, National Sun Yat-sen University, No. 70, Lianhai Rd., Gushan District, Kaohsiung 80424, Kaohsiung, Taiwan, 886 983337217.
  • Department of Anesthesiology, Kaohsiung Medical University Hospital, Kaohsiung, Taiwan.

ORCID-Profile: Huan-Jun Wang, Wei-Po Lee, Tz-Ping Gau, Kuang-I Cheng, Cheng-Ru Wei

Zitieren

APA

Wang, H. J., Lee, W. P., Gau, T. P., Cheng, K. I., & Wei, C. R. (2026). Prediction of Postoperative Vomiting Within 24 Hours Using Machine Learning With Large Language Model–Enhanced Interpretability: Development and Validation Study. JMIR Medical Informatics, 14, e84260-e84260. https://doi.org/10.2196/84260

Vancouver

Wang HJ, Lee WP, Gau TP, Cheng KI, Wei CR. Prediction of Postoperative Vomiting Within 24 Hours Using Machine Learning With Large Language Model–Enhanced Interpretability: Development and Validation Study. JMIR Medical Informatics. 2026;14:e84260-e84260. doi:10.2196/84260

BibTeX
@article{Wang2026,
  author = {Wang, Huan-Jun and Lee, Wei-Po and Gau, Tz-Ping and Cheng, Kuang-I and Wei, Cheng-Ru},
  title = {Prediction of Postoperative Vomiting Within 24 Hours Using Machine Learning With Large Language Model–Enhanced Interpretability: Development and Validation Study},
  journal = {JMIR Medical Informatics},
  year = {2026},
  volume = {14},
  pages = {e84260--e84260},
  doi = {10.2196/84260}
}
Kostenlos starten →