Evaluation and enhancement of suspected opioid overdose definitions in emergency medical services data using machine learning with natural language processing
PLOS One · 28.04.2026 · 21 (4) · e0347589
DOI: 10.1371/journal.pone.0347589 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS One, online erschienen am 28.04.2026. Verfasst von Peter Rock und 4 weiteren Autor:innen. Beteiligte Einrichtung: Institute for Biomedical Informatics, University of Kentucky, Lexington, Kentucky, United States of America. Hauptthemen laut MEDLINE: Machine Learning, Natural Language Processing, Opiate Overdose, Emergency Medical Services. Die Arbeit nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NIDA NIH HHS, NCIPC CDC HHS, National Institute of Health.
Abstract (Originalsprache)
Background
Fatal and non-fatal drug overdoses have evolved into a critical public health crisis, with over a 50% increase in the rate of fatal drug overdose since 2019. Emergency Medical Services (EMS) data has advantages over traditional emergency department data, including timeliness and captured non-transport encounters. However, there is no consensus EMS definition for suspected opioid overdose (SOO), and currently implemented knowledge-based (KB) definition may miss ambiguous cases. Machine learning with natural language processing (ML-NLP) has the potential to enhance SOO identification.
Methods
Secondary data originated from an oversampled dataset of 2,327 weighted encounters from Kentucky State EMS data (2018–2022). EMS experts manually reviewed the records and determined ground truth SOO labels. We examined five commonly accepted KB definitions, ranging from narrow to highly inclusive criteria, spanning from structured-only data to combinations of structured and unstructured data. ML-NLP models were developed considering various EMS data fields and KB indicators. The models and KB definitions were evaluated using sensitivity, specificity, accuracy, precision, and F1-score.
Results
The ML-NLP models outperformed the KB definitions with the structured plus KB model achieving the highest F-score (0.81). Structured-only approaches demonstrated low sensitivity (0.30–0.45). The inclusion of patient care narratives and additional structured fields improved model performance with the ML-NLP models demonstrating high sensitivity (89.1%) and precision (89.0%).
Conclusion
Integrated ML-NLP approaches offer significant improvements in opioid overdose surveillance compared to structured-only, unstructured-only, and KB-only approaches. Future research should explore the generalizability of these models across different populations and geographic areas.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Substanzen
Autor:innen und Institutionen
- Institute for Biomedical Informatics, University of Kentucky, Lexington, Kentucky, United States of America.
- Department of Biostatistics, College of Public Health, University of Kentucky, Lexington, Kentucky, United States of America.
- Kentucky Injury Prevention and Research Center, University of Kentucky, Lexington, Kentucky, United States of America.
- Department of Behavioral Science, College of Medicine, University of Kentucky, Lexington, Kentucky, United States of America.
- Department of Behavioral Science, Center on Drug and Alcohol Research, University of Kentucky, Lexington, Kentucky, United States of America.
- Department of Emergency Medicine, University of Kentucky, Lexington, Kentucky, United States of America.
ORCID-Profile: Peter Rock, Julia Martin
Förderung
- NIDA NIH HHS
- NCIPC CDC HHS
- National Institute of Health
- Centers for Disease Control and Prevention
Zitieren
APA
Rock, P., Slavova, S., Walsh, S. L., Martin, J., & Harris, D. R. (2026). Evaluation and enhancement of suspected opioid overdose definitions in emergency medical services data using machine learning with natural language processing. PLOS One, 21(4), e0347589. https://doi.org/10.1371/journal.pone.0347589
Vancouver
Rock P, Slavova S, Walsh SL, Martin J, Harris DR. Evaluation and enhancement of suspected opioid overdose definitions in emergency medical services data using machine learning with natural language processing. PLOS One. 2026;21(4):e0347589. doi:10.1371/journal.pone.0347589
BibTeX
@article{Rock2026,
author = {Rock, Peter and Slavova, Svetla and Walsh, Sharon L and Martin, Julia and Harris, Daniel R},
title = {Evaluation and enhancement of suspected opioid overdose definitions in emergency medical services data using machine learning with natural language processing},
journal = {PLOS One},
year = {2026},
volume = {21},
number = {4},
pages = {e0347589},
doi = {10.1371/journal.pone.0347589}
}
EUVIMED