Automated Identification of Stroke Thrombolysis Contraindications from Synthetic Clinical Notes: A Proof-of-Concept Study
Cerebrovascular Diseases Extra · 2025
DOI: 10.1159/000545317 ↗Kurz gefasst
Fachartikel in der Zeitschrift Cerebrovascular Diseases Extra, 2025. Verfasst von Bing Yu Chen und 9 weiteren Autor:innen. Beteiligte Einrichtung: Neurological Institute, Cleveland Clinic, Cleveland, Ohio, USA. Hauptthemen laut MEDLINE: Thrombolytic Therapy, Electronic Health Records, Fibrinolytic Agents, Natural Language Processing. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 18 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Themen: Schlaganfall
Abstract (Originalsprache)
Introduction
Timely thrombolytic therapy improves outcomes in acute ischemic stroke. Manual chart review to screen for thrombolysis contraindications may be time-consuming and prone to errors. We developed and tested a large language model (LLM)-based tool to identify thrombolysis contraindications from clinical notes using synthetic data in a proof-of-concept study.
Methods
We generated 150 synthetic clinical notes containing randomly assigned thrombolysis contraindications using LLMs. We then used Llama 3.1 405B with a custom prompt to generate a list of thrombolysis contraindications from each note. Performance was evaluated using sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), accuracy, and F1 score.
Results
A total of 150 synthetic notes were generated using five different models: ChatGPT-4o, Llama 3.1 405B, Llama 3.1 70B, ChatGPT-4o mini, and Gemini 1.5 Flash. On average, each note contained 241.6 words (SD 110.7; range 80–549) and included 1.5 contraindications (SD 1.1; range 0–5). Our tool achieved a sensitivity of 90.9% (95% CI: 86.3%–94.3%), specificity of 99.2% (95% CI: 98.8%–99.5%), PPV of 87.7% (95% CI: 82.7%–91.7%), NPV of 99.4% (95% CI: 99.1%–99.6%), accuracy of 98.7% (95% CI: 98.2%–99.0%), and an F1 score of 0.892. Among the false positives, 24 (86%) were due to the inclusion of irrelevant contraindications, and 4 (14%) resulted from repetitive information. No hallucinations were observed.
Conclusion
Our LLM-based tool may identify stroke thrombolysis contraindications from synthetic clinical notes with high sensitivity and PPV. Future studies will validate its performance using real EMR data and integrate it into acute stroke workflows to facilitate faster and safer thrombolysis decision-making.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Substanzen
Autor:innen und Institutionen
- Neurological Institute, Cleveland Clinic, Cleveland, Ohio, USA.
- Cole Eye Institute, Cleveland Clinic, Cleveland, Ohio, USA.
- Pathology and Laboratory Medicine Institute, Cleveland Clinic, Cleveland, Ohio, USA.
Zitieren
APA
Chen, B. Y., Antaki, F., Gonzalez, M., Uchino, K., Albahra, S., Robertson, S., Ibrikji, S., Aube, E., Russman, A., & Hussain, M. S. (2025). Automated Identification of Stroke Thrombolysis Contraindications from Synthetic Clinical Notes: A Proof-of-Concept Study. Cerebrovascular Diseases Extra. https://doi.org/10.1159/000545317
Vancouver
Chen BY, Antaki F, Gonzalez M, Uchino K, Albahra S, Robertson S, et al. Automated Identification of Stroke Thrombolysis Contraindications from Synthetic Clinical Notes: A Proof-of-Concept Study. Cerebrovascular Diseases Extra. 2025. doi:10.1159/000545317
BibTeX
@article{Chen2025,
author = {Chen, Bing Yu and Antaki, Fares and Gonzalez, Marco and Uchino, Ken and Albahra, Samer and Robertson, Scott and Ibrikji, Sidonie and Aube, Eric and Russman, Andrew and Hussain, Muhammad Shazam},
title = {Automated Identification of Stroke Thrombolysis Contraindications from Synthetic Clinical Notes: A Proof-of-Concept Study},
journal = {Cerebrovascular Diseases Extra},
year = {2025},
doi = {10.1159/000545317}
}
EUVIMED