EUVIMEDEUVIMED entdecken
Open Access

Classifying Firearm Injury Intent in Electronic Hospital Records Using Natural Language Processing

Erin MacPhaul, Li Zhou, Stephen J Mooney, Deborah Azrael, Andrew Bowen, Ali Rowhani-Rahbar, Ravali Yenduri, Catherine Barber, Eric Goralnick, Matthew Miller

JAMA Network Open · 06.04.2023 · 6 (4) · e235870

DOI: 10.1001/jamanetworkopen.2023.5870 ↗

Kurz gefasst

Fachartikel in der Zeitschrift JAMA Network Open, online erschienen am 06.04.2023. Verfasst von Erin MacPhaul und 9 weiteren Autor:innen. Beteiligte Einrichtung: Department of Emergency Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts. Hauptthemen laut MEDLINE: Firearms, Wounds, Gunshot. Die Arbeit wurde bisher 18-mal zitiert (Crossref) und nennt 21 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Importance International Classification of Diseases –coded hospital discharge data do not accurately reflect whether firearm injuries were caused by assault, unintentional injury, self-harm, legal intervention, or were of undetermined intent. Applying natural language processing (NLP) and machine learning (ML) techniques to electronic health record (EHR) narrative text could be associated with improved accuracy of firearm injury intent data.

Objective

To assess the accuracy with which an ML model identified firearm injury intent. Design, Setting, and Participants A cross-sectional retrospective EHR review was conducted at 3 level I trauma centers, 2 from health care institutions in Boston, Massachusetts, and 1 from Seattle, Washington, between January 1, 2000, and December 31, 2019; data analysis was performed from January 18, 2021, to August 22, 2022. A total of 1915 incident cases of firearm injury in patients presenting to emergency departments at the model development institution and 769 from the external validation institution with a firearm injury code assigned according to International Classification of Diseases , Ninth Revision, Clinical Modification ( ICD-9-CM ) or International Statistical Classification of Diseases and Related Health Problems, 10th Revision, Clinical Modification ( ICD-10-CM ), in discharge data were included. Exposures Classification of firearm injury intent. Main Outcomes and Measures Intent classification accuracy by the NLP model was compared with ICD codes assigned by medical record coders in discharge data. The NLP model extracted intent-relevant features from narrative text that were then used by a gradient-boosting classifier to determine the intent of each firearm injury. Classification accuracy was evaluated against intent assigned by the research team. The model was further validated using an external data set.

Results

The NLP model was evaluated in 381 patients presenting with firearm injury at the model development site (mean [SD] age, 39.2 [13.0] years; 348 [91.3%] men) and 304 patients at the external development site (mean [SD] age, 31.8 [14.8] years; 263 [86.5%] men). The model proved more accurate than medical record coders in assigning intent to firearm injuries at the model development site (accident F-score, 0.78 vs 0.40; assault F-score, 0.90 vs 0.78). The model maintained this improvement on an external validation set from a second institution (accident F-score, 0.64 vs 0.58; assault F-score, 0.88 vs 0.81). While the model showed some degradation between institutions, retraining the model using data from the second institution further improved performance on that site’s records (accident F-score, 0.75; assault F-score, 0.92). Conclusions and Relevance The findings of this study suggest that NLP ML can be used to improve the accuracy of firearm injury intent classification compared with ICD -coded discharge data, particularly for cases of accident and assault intents (the most prevalent and commonly misclassified intent types). Future research could refine this model using larger and more diverse data sets.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

FirearmsWounds, GunshotMaleHumansAdultFemaleNatural Language ProcessingRetrospective StudiesCross-Sectional StudiesHospital RecordsElectronic Health Records

Autor:innen und Institutionen

  • Department of Emergency Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts.
  • Firearm Injury & Policy Research Program, University of Washington, Seattle.
  • Department of Epidemiology, School of Public Health, University of Washington, Seattle.
  • Harvard Injury Control Research Center, Harvard T. H. Chan School of Public Health, Boston, Massachusetts.
  • Center for Surgery and Public Health, Brigham and Women's Hospital, Boston, Massachusetts.
  • Department of Health Sciences, Bouve College of Health Sciences, Northeastern University, Boston, Massachusetts.

Zitieren

APA

MacPhaul, E., Zhou, L., Mooney, S. J., Azrael, D., Bowen, A., Rowhani-Rahbar, A., Yenduri, R., Barber, C., Goralnick, E., & Miller, M. (2023). Classifying Firearm Injury Intent in Electronic Hospital Records Using Natural Language Processing. JAMA Network Open, 6(4), e235870. https://doi.org/10.1001/jamanetworkopen.2023.5870

Vancouver

MacPhaul E, Zhou L, Mooney SJ, Azrael D, Bowen A, Rowhani-Rahbar A, et al. Classifying Firearm Injury Intent in Electronic Hospital Records Using Natural Language Processing. JAMA Network Open. 2023;6(4):e235870. doi:10.1001/jamanetworkopen.2023.5870

BibTeX
@article{MacPhaul2023,
  author = {MacPhaul, Erin and Zhou, Li and Mooney, Stephen J and Azrael, Deborah and Bowen, Andrew and Rowhani-Rahbar, Ali and Yenduri, Ravali and Barber, Catherine and Goralnick, Eric and Miller, Matthew},
  title = {Classifying Firearm Injury Intent in Electronic Hospital Records Using Natural Language Processing},
  journal = {JAMA Network Open},
  year = {2023},
  volume = {6},
  number = {4},
  pages = {e235870},
  doi = {10.1001/jamanetworkopen.2023.5870}
}
Kostenlos starten →