A large language model-based clinical decision support system for syncope recognition in the emergency department: A framework for clinical workflow integration
European Journal of Internal Medicine · 2025-01 · 131 · 113-120
DOI: 10.1016/j.ejim.2024.09.017 ↗Kurz gefasst
Fachartikel in der Zeitschrift European Journal of Internal Medicine, 2025-01. Verfasst von Alessandro Giaj Levra und 7 weiteren Autor:innen. Beteiligte Einrichtung: Department of Cardiovascular Medicine, Humanitas Research Hospital, IRCCS, Rozzano, Milan, Italy; Department of Biomedical Sciences, Humanitas Univer…. Hauptthemen laut MEDLINE: Syncope, Emergency Service, Hospital, Workflow, Electronic Health Records. Die Arbeit wurde bisher 39-mal zitiert (Crossref) und nennt 37 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).
Abstract (Originalsprache)
Differentiation of syncope from transient loss of consciousness can be challenging in the emergency department (ED). Natural Language Processing (NLP) enables the analysis of free text in the electronic medical records (EMR). The present paper aimed to develop a large language models (LLM) for syncope recognition in the ED and proposed a framework for model integration within the clinical workflow. Two models, based on both the Italian and Multilingual Bidirectional Encoder Representations from Transformers (BERT) language model, were developed using consecutive EMRs. The "triage" model was only based on notes contained in the "triage" section of the EMR. The "anamnesis" model added data contained in the "medical history" section. Interpretation and calibration plots were generated. The Italian and Multi BERT models were developed and tested on both 15,098 and 15,222 EMRs, respectively. The triage model had an AUC of 0·95 for the Italian BERT and 0·94 for the Multi BERT. The anamnesis model had an AUC of 0·98 for the Italian BERT and 0·97 for Multi BERT. The LLM identified syncope when not explicitly mentioned in the EMR and also recognized common prodromal symptoms preceding syncope. Both models identified syncope patients in the ED with a high discriminative capability from nurses and doctors' notes, thus potentially acting as a tool helping physicians to differentiate syncope from others transient loss of consciousness.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Cardiovascular Medicine, Humanitas Research Hospital, IRCCS, Rozzano, Milan, Italy; Department of Biomedical Sciences, Humanitas University, Pieve Emanuele, Milan, Italy.
- IBM, Milan, Italy.
- Hôpital Cardiologique du Haut Lévêque, CHU Bordeaux, France & IHU LIRYC (L'Institut de Rythmologie et Modélisation Cardiaque), Université de Bordeaux, Pessac, France.
- Department of Biomedical Sciences, Humanitas University, Pieve Emanuele, Milan, Italy; Emergency Department, IRCCS Humanitas Research Hospital, Rozzano, Milan, Italy.
- Emergency Department, Fondazione IRCCS Ca' Granda Ospedale Maggiore Policlinico, Università degli Studi di Milano, Milan, Italy.
- Department of Cardiovascular Medicine, Humanitas Research Hospital, IRCCS, Rozzano, Milan, Italy; Department of Biomedical Sciences, Humanitas University, Pieve Emanuele, Milan, Italy. Electronic address: raffaello.furl…
Zitieren
APA
Levra, A. G., Gatti, M., Mene, R., Shiffer, D., Costantino, G., Solbiati, M., Furlan, R., & Dipaola, F. (2025). A large language model-based clinical decision support system for syncope recognition in the emergency department: A framework for clinical workflow integration. European Journal of Internal Medicine, 131, 113-120. https://doi.org/10.1016/j.ejim.2024.09.017
Vancouver
Levra AG, Gatti M, Mene R, Shiffer D, Costantino G, Solbiati M, et al. A large language model-based clinical decision support system for syncope recognition in the emergency department: A framework for clinical workflow integration. European Journal of Internal Medicine. 2025;131:113-120. doi:10.1016/j.ejim.2024.09.017
BibTeX
@article{Levra2025,
author = {Levra, Alessandro Giaj and Gatti, Mauro and Mene, Roberto and Shiffer, Dana and Costantino, Giorgio and Solbiati, Monica and Furlan, Raffaello and Dipaola, Franca},
title = {A large language model-based clinical decision support system for syncope recognition in the emergency department: A framework for clinical workflow integration},
journal = {European Journal of Internal Medicine},
year = {2025},
volume = {131},
pages = {113--120},
doi = {10.1016/j.ejim.2024.09.017}
}
EUVIMED