EUVIMEDEUVIMED entdecken
Open Access

Machine Learning Multimodal Model for Delirium Risk Stratification

Machine-Learning-Multimodalmodell zur Delir-Risikostratifizierung

Joseph I Friedman, Prathamesh Parchure, Fu-Yuan Cheng, Weijia Fu, Satyanarayana Cheertirala, Prem Timsina, Ganesh Raut, Katherine Reina, Josiane Joseph-Jimerson, Madhu Mazumdar, Robert Freeman, David L Reich und 1 weitere

JAMA Network Open · 07.05.2025 · 8 (5) · e258874

DOI: 10.1001/jamanetworkopen.2025.8874 ↗

Auf einen Blick

Eine Qualitätsverbesserungsstudie prüfte ein multimodales ML-Modell zur Delir-Risikostratifizierung im klinischen Alltag. Die Validierung ergab eine AUC von 0,94; die Delirerkennung stieg von 4,42 % auf 17,17 %.

Fragestellung

Wie gut lässt sich ein multimodales ML-Modell zur Risikostratifizierung für stationäres Delir im klinischen Alltag entwickeln, einsetzen und validieren, und wie ist es mit Workflow- und klinischen Outcomes verbunden?

Methode

Qualitätsverbesserungsstudie mit ML-Modell auf Basis elektronischer Krankenakten und klinischer Notizen; Referenzstandard war die Confusion Assessment Method. Entwicklung/Validierung an Patient:innen ab 60 Jahren auf nicht-ITS-Stationen; Auswertung der Prä-/Post-ML-Kohorten retrospektiv 2024.

Ergebnisse

32 284 stationäre Aufnahmen. Validierung im klinischen Alltag: AUC 0,94 (95 %-KI 0,93-0,95). Delirerkennung pro Monat: 4,42 % (95 %-KI 3,70 %-5,14 %) vor ML vs. 17,17 % (95 %-KI 15,54 %-18,80 %) nach ML. Benzodiazepine und Olanzapin niedriger nach ML.

Schlussfolgerung der Autor:innen

Die Studie zeigt die Machbarkeit eines neuen multimodalen ML-Modells zur automatischen Delir-Risikostratifizierung im klinischen Alltag. Das Modell zeigte eine akzeptable Leistung und könnte die Ressourcenallokation für Delirerkennung und -versorgung unterstützen.

Kernaussagen

  • AUC in der Live-Validierung: 0,94 (95 %-KI 0,93-0,95)
  • Delirerkennung stieg von 4,42 % auf 17,17 %
  • Niedrigere tägliche Dosen von Benzodiazepinen und Olanzapin nach ML

Deutsche Zusammenfassung: KI-gestützt aus dem Original-Abstract erstellt; alle Zahlen wurden automatisch mit dem Original abgeglichen. Maßgeblich ist der Original-Abstract.

Kurz gefasst

Fachartikel in der Zeitschrift JAMA Network Open, online erschienen am 07.05.2025. Verfasst von Joseph I Friedman und 12 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychiatry, Icahn School of Medicine at Mount Sinai, New York, New York. Hauptthemen laut MEDLINE: Delirium, Machine Learning. Die Arbeit wurde bisher 24-mal zitiert (Crossref) und nennt 61 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

Auf einen BlickAbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Importance Automating the identification of risk for developing hospital delirium with models that use machine learning (ML) could facilitate more rapid prevention, identification, and treatment of delirium. However, there are very few reports on the performance of ML models for delirium risk stratification in live clinical practice.

Objective

To report on development, operationalization, and validation of a multimodal ML model for delirium risk stratification in live clinical practice and its associations with workflow and clinical outcomes. Design, Setting, and Participants This quality improvement study developed an ML model supported by automated electronic medical records to stratify the risk of non–intensive care unit delirium in live clinical practice using the Confusion Assessment Method as the diagnostic reference standard, with an iterative model update method. Data from patients aged at least 60 years admitted to non–intensive care units at Mount Sinai Hospital between January 2016 and January 2020 were used to train and test the ML model presented. The model was validated in live clinical practice from March 2023 to March 2024. Analysis of the model’s associations with workflow and clinical outcomes was conducted retrospectively in 2024, comparing hospitalized patients prior to deployment of any model version (pre-ML cohort) and during model clinical deployment (post-ML cohort). Main Outcomes and Measures Outcomes of interest were area under the receiver operating characteristic curve, monthly delirium detection rates, median length of hospital stay, and daily doses of opiate, benzodiazepine, and antipsychotic medications administered.

Results

The overall sample included 32 284 inpatient admissions (mean [SD] age, 73.56 (9.67) years, 15 157 [46.9%] women). A total of 25 261 inpatient admissions of older patients with both medical and surgical primary diagnoses represented the combined model testing and training cohort (median age, 73.37 [66.42-81.36] years) and live clinical deployment validation cohort (median [IQR] age, 72.11 [62.26-78.97] years), while 7023 inpatient admissions of older patients with both medical and surgical primary diagnoses represented the combined pre-ML (median [IQR] age, 74.00 [68.00-81.00] years) and post-ML (median [IQR] age, 75.33 [68.34-82.91] years) cohorts. The model presented is a fusion of electronic medical record patient data features and clinical note features processed by natural language processing. The results of model validation in live clinical practice included an area under the curve of 0.94 (95% CI, 0.93-0.95). Median (IQR) monthly delirium detection rates of inpatients assessed for delirium with the Confusion Assessment Method increased from 4.42% (95% CI, 3.70%-5.14%) in the pre-ML cohort to 17.17% (95% CI, 15.54%-18.80%) in the post-ML cohort ( P < .001). Post-ML vs pre-ML cohorts received lower daily doses of benzodiazepines (median [IQR] 0.93 [0.42-2.28] diazepam dose equivalents vs 1.60 [0.66-4.27] diazepam dose equivalents; P < .001) and olanzapine (median [IQR], 1.09 [0.38-2.46] mg vs 2.50 [1.17-6.65] mg; P < .001). Conclusions and Relevance This quality improvement study demonstrates the feasibility of a novel multimodal ML model to automate delirium risk stratification in live clinical practice. The model demonstrated acceptable performance in live clinical practice and may facilitate resource allocation to enhance delirium identification and care.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

DeliriumMachine LearningHumansFemaleMaleRisk AssessmentAgedRetrospective StudiesMiddle AgedAged, 80 and overElectronic Health RecordsQuality Improvement

Autor:innen und Institutionen

  • Department of Psychiatry, Icahn School of Medicine at Mount Sinai, New York, New York.
  • Department of Neuroscience, Icahn School of Medicine at Mount Sinai, New York, New York.
  • Institute for Healthcare Delivery Science, Icahn School of Medicine at Mount Sinai, New York, New York.
  • Nursing Administration, Mount Sinai Morningside Hospital, New York, New York.
  • Department of Nursing, The Mount Sinai Hospital, New York, New York.
  • Department of Population Health Science and Policy, Icahn School of Medicine at Mount Sinai, New York, New York.

Zitieren

APA

Friedman, J. I., Parchure, P., Cheng, F. Y., Fu, W., Cheertirala, S., Timsina, P., Raut, G., Reina, K., Joseph-Jimerson, J., Mazumdar, M., Freeman, R., Reich, D. L., & Kia, A. (2025). Machine Learning Multimodal Model for Delirium Risk Stratification. JAMA Network Open, 8(5), e258874. https://doi.org/10.1001/jamanetworkopen.2025.8874

Vancouver

Friedman JI, Parchure P, Cheng FY, Fu W, Cheertirala S, Timsina P, et al. Machine Learning Multimodal Model for Delirium Risk Stratification. JAMA Network Open. 2025;8(5):e258874. doi:10.1001/jamanetworkopen.2025.8874

BibTeX
@article{Friedman2025,
  author = {Friedman, Joseph I and Parchure, Prathamesh and Cheng, Fu-Yuan and Fu, Weijia and Cheertirala, Satyanarayana and Timsina, Prem and Raut, Ganesh and Reina, Katherine and Joseph-Jimerson, Josiane and Mazumdar, Madhu and Freeman, Robert and Reich, David L and Kia, Arash},
  title = {Machine Learning Multimodal Model for Delirium Risk Stratification},
  journal = {JAMA Network Open},
  year = {2025},
  volume = {8},
  number = {5},
  pages = {e258874},
  doi = {10.1001/jamanetworkopen.2025.8874}
}
Kostenlos starten →