Machine Learning Multimodal Model for Delirium Risk Stratification
Machine-Learning-Multimodalmodell zur Delir-Risikostratifizierung
JAMA Network Open · 07.05.2025 · 8 (5) · e258874
DOI: 10.1001/jamanetworkopen.2025.8874 ↗Auf einen Blick
Eine Qualitätsverbesserungsstudie prüfte ein multimodales ML-Modell zur Delir-Risikostratifizierung im klinischen Alltag. Die Validierung ergab eine AUC von 0,94; die Delirerkennung stieg von 4,42 % auf 17,17 %.
Fragestellung
Wie gut lässt sich ein multimodales ML-Modell zur Risikostratifizierung für stationäres Delir im klinischen Alltag entwickeln, einsetzen und validieren, und wie ist es mit Workflow- und klinischen Outcomes verbunden?
Methode
Qualitätsverbesserungsstudie mit ML-Modell auf Basis elektronischer Krankenakten und klinischer Notizen; Referenzstandard war die Confusion Assessment Method. Entwicklung/Validierung an Patient:innen ab 60 Jahren auf nicht-ITS-Stationen; Auswertung der Prä-/Post-ML-Kohorten retrospektiv 2024.
Ergebnisse
32 284 stationäre Aufnahmen. Validierung im klinischen Alltag: AUC 0,94 (95 %-KI 0,93-0,95). Delirerkennung pro Monat: 4,42 % (95 %-KI 3,70 %-5,14 %) vor ML vs. 17,17 % (95 %-KI 15,54 %-18,80 %) nach ML. Benzodiazepine und Olanzapin niedriger nach ML.
Schlussfolgerung der Autor:innen
Die Studie zeigt die Machbarkeit eines neuen multimodalen ML-Modells zur automatischen Delir-Risikostratifizierung im klinischen Alltag. Das Modell zeigte eine akzeptable Leistung und könnte die Ressourcenallokation für Delirerkennung und -versorgung unterstützen.
Kernaussagen
- AUC in der Live-Validierung: 0,94 (95 %-KI 0,93-0,95)
- Delirerkennung stieg von 4,42 % auf 17,17 %
- Niedrigere tägliche Dosen von Benzodiazepinen und Olanzapin nach ML
Deutsche Zusammenfassung: KI-gestützt aus dem Original-Abstract erstellt; alle Zahlen wurden automatisch mit dem Original abgeglichen. Maßgeblich ist der Original-Abstract.
Kurz gefasst
Fachartikel in der Zeitschrift JAMA Network Open, online erschienen am 07.05.2025. Verfasst von Joseph I Friedman und 12 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychiatry, Icahn School of Medicine at Mount Sinai, New York, New York. Hauptthemen laut MEDLINE: Delirium, Machine Learning. Die Arbeit wurde bisher 24-mal zitiert (Crossref) und nennt 61 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Importance Automating the identification of risk for developing hospital delirium with models that use machine learning (ML) could facilitate more rapid prevention, identification, and treatment of delirium. However, there are very few reports on the performance of ML models for delirium risk stratification in live clinical practice.
Objective
To report on development, operationalization, and validation of a multimodal ML model for delirium risk stratification in live clinical practice and its associations with workflow and clinical outcomes. Design, Setting, and Participants This quality improvement study developed an ML model supported by automated electronic medical records to stratify the risk of non–intensive care unit delirium in live clinical practice using the Confusion Assessment Method as the diagnostic reference standard, with an iterative model update method. Data from patients aged at least 60 years admitted to non–intensive care units at Mount Sinai Hospital between January 2016 and January 2020 were used to train and test the ML model presented. The model was validated in live clinical practice from March 2023 to March 2024. Analysis of the model’s associations with workflow and clinical outcomes was conducted retrospectively in 2024, comparing hospitalized patients prior to deployment of any model version (pre-ML cohort) and during model clinical deployment (post-ML cohort). Main Outcomes and Measures Outcomes of interest were area under the receiver operating characteristic curve, monthly delirium detection rates, median length of hospital stay, and daily doses of opiate, benzodiazepine, and antipsychotic medications administered.
Results
The overall sample included 32 284 inpatient admissions (mean [SD] age, 73.56 (9.67) years, 15 157 [46.9%] women). A total of 25 261 inpatient admissions of older patients with both medical and surgical primary diagnoses represented the combined model testing and training cohort (median age, 73.37 [66.42-81.36] years) and live clinical deployment validation cohort (median [IQR] age, 72.11 [62.26-78.97] years), while 7023 inpatient admissions of older patients with both medical and surgical primary diagnoses represented the combined pre-ML (median [IQR] age, 74.00 [68.00-81.00] years) and post-ML (median [IQR] age, 75.33 [68.34-82.91] years) cohorts. The model presented is a fusion of electronic medical record patient data features and clinical note features processed by natural language processing. The results of model validation in live clinical practice included an area under the curve of 0.94 (95% CI, 0.93-0.95). Median (IQR) monthly delirium detection rates of inpatients assessed for delirium with the Confusion Assessment Method increased from 4.42% (95% CI, 3.70%-5.14%) in the pre-ML cohort to 17.17% (95% CI, 15.54%-18.80%) in the post-ML cohort ( P < .001). Post-ML vs pre-ML cohorts received lower daily doses of benzodiazepines (median [IQR] 0.93 [0.42-2.28] diazepam dose equivalents vs 1.60 [0.66-4.27] diazepam dose equivalents; P < .001) and olanzapine (median [IQR], 1.09 [0.38-2.46] mg vs 2.50 [1.17-6.65] mg; P < .001). Conclusions and Relevance This quality improvement study demonstrates the feasibility of a novel multimodal ML model to automate delirium risk stratification in live clinical practice. The model demonstrated acceptable performance in live clinical practice and may facilitate resource allocation to enhance delirium identification and care.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Department of Psychiatry, Icahn School of Medicine at Mount Sinai, New York, New York.
- Department of Neuroscience, Icahn School of Medicine at Mount Sinai, New York, New York.
- Institute for Healthcare Delivery Science, Icahn School of Medicine at Mount Sinai, New York, New York.
- Nursing Administration, Mount Sinai Morningside Hospital, New York, New York.
- Department of Nursing, The Mount Sinai Hospital, New York, New York.
- Department of Population Health Science and Policy, Icahn School of Medicine at Mount Sinai, New York, New York.
Zitieren
APA
Friedman, J. I., Parchure, P., Cheng, F. Y., Fu, W., Cheertirala, S., Timsina, P., Raut, G., Reina, K., Joseph-Jimerson, J., Mazumdar, M., Freeman, R., Reich, D. L., & Kia, A. (2025). Machine Learning Multimodal Model for Delirium Risk Stratification. JAMA Network Open, 8(5), e258874. https://doi.org/10.1001/jamanetworkopen.2025.8874
Vancouver
Friedman JI, Parchure P, Cheng FY, Fu W, Cheertirala S, Timsina P, et al. Machine Learning Multimodal Model for Delirium Risk Stratification. JAMA Network Open. 2025;8(5):e258874. doi:10.1001/jamanetworkopen.2025.8874
BibTeX
@article{Friedman2025,
author = {Friedman, Joseph I and Parchure, Prathamesh and Cheng, Fu-Yuan and Fu, Weijia and Cheertirala, Satyanarayana and Timsina, Prem and Raut, Ganesh and Reina, Katherine and Joseph-Jimerson, Josiane and Mazumdar, Madhu and Freeman, Robert and Reich, David L and Kia, Arash},
title = {Machine Learning Multimodal Model for Delirium Risk Stratification},
journal = {JAMA Network Open},
year = {2025},
volume = {8},
number = {5},
pages = {e258874},
doi = {10.1001/jamanetworkopen.2025.8874}
}
EUVIMED