EUVIMEDEUVIMED entdecken
ValidierungsstudieOpen Access

GPT-4o–Powered Preanesthetic AI: Development and Validation Study

Bo-Han Lin iD, Cheng-Wei Lu iD, I-Ching Hou iD, Tzu-Yu Lin iD, Chin-E Liu iD, Chong-Sun Khoi iD

JMIR Medical Informatics · 25.08.2026 · 14 · e83893-e83893

DOI: 10.2196/83893 ↗

Kurz gefasst

Validierungsstudie in der Zeitschrift JMIR Medical Informatics, online erschienen am 25.08.2026. Verfasst von Bo-Han Lin und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Anesthesiology, Far Eastern Memorial Hospital, No. 21, Section 2, Nanya S. Road, Banqiao District, New Taipei City, 220, Taiwan, +886-2…. Hauptthemen laut MEDLINE: Preoperative Care. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 18 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Accurate preanesthetic assessment is essential for perioperative risk stratification, but conventional tools such as the American Society of Anesthesiologists (ASA) physical status classification and postoperative nausea and vomiting (PONV) risk scores may be affected by subjective judgment, incomplete documentation, and fragmented clinical data. Large language models may support preanesthetic assessment by integrating structured and unstructured clinical information.

Objective

This study aimed to develop and retrospectively validate a GPT-4o (OpenAI)–powered AI system for preanesthetic assessment. The primary validation focus was the agreement between AI-generated and clinician-assigned ASA physical status classifications. PONV risk stratification was evaluated as an additional clinically relevant performance outcome. A secondary objective was to assess the incremental contribution of National Health Insurance (NHI) cloud data to model performance.

Methods

This single-center retrospective validation study included 600 adult surgical patients randomly sampled from 4404 eligible inpatient surgical patients between January and May 2025. The system processed structured and unstructured electronic health record data, with and without NHI cloud data, to generate preanesthetic assessment outputs. ASA agreement was assessed using Cohen κ with 95% CIs. PONV prediction was evaluated using sensitivity, specificity, overall accuracy, positive predictive value, negative predictive value, confusion matrix analysis, the 2-sided Fisher-Freeman-Halton exact test, and Cramér V.

Results

Among the 600 patients, clinician-assigned ASA classifications were ASA I in 39 patients, ASA II in 498 patients, ASA III in 57 patients, and ASA IV in 6 patients. Agreement between AI-generated and clinician-assigned ASA classifications was high when NHI data were incorporated (κ=0.883, 95% CI 0.841‐0.946), whereas agreement was lower without NHI data (κ=0.518, 95% CI 0.412‐0.691). A total of 49 (8.2%) patients experienced documented PONV within 24 hours after surgery. Using the high-risk category as the primary test-positive threshold, the model achieved a sensitivity of 34.7% (95% CI 22.9‐48.7), a specificity of 99.1% (95% CI 97.9‐99.6), a positive predictive value of 77.3%, and a negative predictive value of 94.5%. The association between the model-assigned PONV risk categories and observed PONV outcomes was statistically significant ( P

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Preoperative CareHumansRetrospective StudiesFemaleGenerative Artificial IntelligenceMiddle AgedRisk AssessmentLarge Language ModelsAdultAgedPostoperative Nausea and Vomiting

Stichwörter der Autor:innen

AIASA classificationAmerican Society of AnesthesiologistsGPT-4oPONVelectronic medical recordslarge language modelspostoperative nausea and vomitingpreanesthetic assessment

Autor:innen und Institutionen

  • Department of Anesthesiology, Far Eastern Memorial Hospital, No. 21, Section 2, Nanya S. Road, Banqiao District, New Taipei City, 220, Taiwan, +886-2-8966-7000 ext 4371.
  • Department of Nursing, National Yang Ming Chiao Tung University, Taipei City, Taiwan.
  • Department of Mechanical Engineering, College of Engineering, Yuan Ze University, Taoyuan City, Taiwan.
  • Graduate School of Biotechnology and Bioengineering, College of Medicine and Nursing, Yuan Ze University, Taoyuan City, Taiwan.

ORCID-Profile: Bo-Han Lin, Cheng-Wei Lu, I-Ching Hou, Tzu-Yu Lin, Chin-E Liu, Chong-Sun Khoi

Zitieren

APA

Lin, B. H., Lu, C. W., Hou, I. C., Lin, T. Y., Liu, C. E., & Khoi, C. S. (2026). GPT-4o–Powered Preanesthetic AI: Development and Validation Study. JMIR Medical Informatics, 14, e83893-e83893. https://doi.org/10.2196/83893

Vancouver

Lin BH, Lu CW, Hou IC, Lin TY, Liu CE, Khoi CS. GPT-4o–Powered Preanesthetic AI: Development and Validation Study. JMIR Medical Informatics. 2026;14:e83893-e83893. doi:10.2196/83893

BibTeX
@article{Lin2026,
  author = {Lin, Bo-Han and Lu, Cheng-Wei and Hou, I-Ching and Lin, Tzu-Yu and Liu, Chin-E and Khoi, Chong-Sun},
  title = {GPT-4o–Powered Preanesthetic AI: Development and Validation Study},
  journal = {JMIR Medical Informatics},
  year = {2026},
  volume = {14},
  pages = {e83893--e83893},
  doi = {10.2196/83893}
}
Kostenlos starten →