EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Evaluation and enhancement of suspected opioid overdose definitions in emergency medical services data using machine learning with natural language processing

Peter Rock iD, Svetla Slavova, Sharon L Walsh, Julia Martin iD, Daniel R Harris

PLOS One · 28.04.2026 · 21 (4) · e0347589

DOI: 10.1371/journal.pone.0347589 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS One, online erschienen am 28.04.2026. Verfasst von Peter Rock und 4 weiteren Autor:innen. Beteiligte Einrichtung: Institute for Biomedical Informatics, University of Kentucky, Lexington, Kentucky, United States of America. Hauptthemen laut MEDLINE: Machine Learning, Natural Language Processing, Opiate Overdose, Emergency Medical Services. Die Arbeit nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NIDA NIH HHS, NCIPC CDC HHS, National Institute of Health.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Fatal and non-fatal drug overdoses have evolved into a critical public health crisis, with over a 50% increase in the rate of fatal drug overdose since 2019. Emergency Medical Services (EMS) data has advantages over traditional emergency department data, including timeliness and captured non-transport encounters. However, there is no consensus EMS definition for suspected opioid overdose (SOO), and currently implemented knowledge-based (KB) definition may miss ambiguous cases. Machine learning with natural language processing (ML-NLP) has the potential to enhance SOO identification.

Methods

Secondary data originated from an oversampled dataset of 2,327 weighted encounters from Kentucky State EMS data (2018–2022). EMS experts manually reviewed the records and determined ground truth SOO labels. We examined five commonly accepted KB definitions, ranging from narrow to highly inclusive criteria, spanning from structured-only data to combinations of structured and unstructured data. ML-NLP models were developed considering various EMS data fields and KB indicators. The models and KB definitions were evaluated using sensitivity, specificity, accuracy, precision, and F1-score.

Results

The ML-NLP models outperformed the KB definitions with the structured plus KB model achieving the highest F-score (0.81). Structured-only approaches demonstrated low sensitivity (0.30–0.45). The inclusion of patient care narratives and additional structured fields improved model performance with the ML-NLP models demonstrating high sensitivity (89.1%) and precision (89.0%).

Conclusion

Integrated ML-NLP approaches offer significant improvements in opioid overdose surveillance compared to structured-only, unstructured-only, and KB-only approaches. Future research should explore the generalizability of these models across different populations and geographic areas.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Machine LearningNatural Language ProcessingOpiate OverdoseEmergency Medical ServicesDrug OverdoseAnalgesics, OpioidHumansKentucky

Substanzen

Analgesics, Opioid

Autor:innen und Institutionen

  • Institute for Biomedical Informatics, University of Kentucky, Lexington, Kentucky, United States of America.
  • Department of Biostatistics, College of Public Health, University of Kentucky, Lexington, Kentucky, United States of America.
  • Kentucky Injury Prevention and Research Center, University of Kentucky, Lexington, Kentucky, United States of America.
  • Department of Behavioral Science, College of Medicine, University of Kentucky, Lexington, Kentucky, United States of America.
  • Department of Behavioral Science, Center on Drug and Alcohol Research, University of Kentucky, Lexington, Kentucky, United States of America.
  • Department of Emergency Medicine, University of Kentucky, Lexington, Kentucky, United States of America.

ORCID-Profile: Peter Rock, Julia Martin

Förderung

  • NIDA NIH HHS
  • NCIPC CDC HHS
  • National Institute of Health
  • Centers for Disease Control and Prevention

Zitieren

APA

Rock, P., Slavova, S., Walsh, S. L., Martin, J., & Harris, D. R. (2026). Evaluation and enhancement of suspected opioid overdose definitions in emergency medical services data using machine learning with natural language processing. PLOS One, 21(4), e0347589. https://doi.org/10.1371/journal.pone.0347589

Vancouver

Rock P, Slavova S, Walsh SL, Martin J, Harris DR. Evaluation and enhancement of suspected opioid overdose definitions in emergency medical services data using machine learning with natural language processing. PLOS One. 2026;21(4):e0347589. doi:10.1371/journal.pone.0347589

BibTeX
@article{Rock2026,
  author = {Rock, Peter and Slavova, Svetla and Walsh, Sharon L and Martin, Julia and Harris, Daniel R},
  title = {Evaluation and enhancement of suspected opioid overdose definitions in emergency medical services data using machine learning with natural language processing},
  journal = {PLOS One},
  year = {2026},
  volume = {21},
  number = {4},
  pages = {e0347589},
  doi = {10.1371/journal.pone.0347589}
}
Kostenlos starten →