Finding Potential Adverse Events in the Unstructured Text of Electronic Health Care Records: Development of the Shakespeare Method
JMIRx Med · 2021-08-11 · 2 (3) · e27017
DOI: 10.2196/27017 ↗At a glance
Journal article in JMIRx Med, published online on 2021-08-11. Written by Roselie A Bright and 5 co-authors. Institution: US Food and Drug Administration, Silver Spring, MD, United States. Cited 10 times so far (Crossref); 118 references. The full text is freely available in PubMed Central.
Topics: Patientensicherheit
Abstract (original language)
Background
Big data tools provide opportunities to monitor adverse events (patient harm associated with medical care) (AEs) in the unstructured text of electronic health care records (EHRs). Writers may explicitly state an apparent association between treatment and adverse outcome (“attributed”) or state the simple treatment and outcome without an association (“unattributed”). Many methods for finding AEs in text rely on predefining possible AEs before searching for prespecified words and phrases or manual labeling (standardization) by investigators. We developed a method to identify possible AEs, even if unknown or unattributed, without any prespecifications or standardization of notes. Our method was inspired by word-frequency analysis methods used to uncover the true authorship of disputed works credited to William Shakespeare. We chose two use cases, “transfusion” and “time-based.” Transfusion was chosen because new transfusion AE types were becoming recognized during the study data period; therefore, we anticipated an opportunity to find unattributed potential AEs (PAEs) in the notes. With the time-based case, we wanted to simulate near real-time surveillance. We chose time periods in the hope of detecting PAEs due to contaminated heparin from mid-2007 to mid-2008 that were announced in early 2008. We hypothesized that the prevalence of contaminated heparin may have been widespread enough to manifest in EHRs through symptoms related to heparin AEs, independent of clinicians’ documentation of attributed AEs.
Objective
We aimed to develop a new method to identify attributed and unattributed PAEs using the unstructured text of EHRs.
Methods
We used EHRs for adult critical care admissions at a major teaching hospital (2001-2012). For each case, we formed a group of interest and a comparison group. We concatenated the text notes for each admission into one document sorted by date, and deleted replicate sentences and lists. We identified statistically significant words in the group of interest versus the comparison group. Documents in the group of interest were filtered to those words, followed by topic modeling on the filtered documents to produce topics. For each topic, the three documents with the maximum topic scores were manually reviewed to identify PAEs.
Results
Topics centered around medical conditions that were unique to or more common in the group of interest, including PAEs. In each use case, most PAEs were unattributed in the notes. Among the transfusion PAEs was unattributed evidence of transfusion-associated cardiac overload and transfusion-related acute lung injury. Some of the PAEs from mid-2007 to mid-2008 were increased unattributed events consistent with AEs related to heparin contamination.
Conclusions
The Shakespeare method could be a useful supplement to AE reporting and surveillance of structured EHR data. Future improvements should include automation of the manual review process.
Subjects
Author keywords
Authors and institutions
- US Food and Drug Administration, Silver Spring, MD, United States.
- Booz Allen Hamilton, McLean, VA, United States.
- US Food and Drug Administration, Rockville, MD, United States.
ORCID profiles: Roselie A Bright, Summer K Rankin, Katherine Dowdy, Sergey V Blok, Susan J Bright, Lee Anne M Palmer
Cite
APA
Bright, R. A., Rankin, S. K., Dowdy, K., Blok, S. V., Bright, S. J., & Palmer, L. A. M. (2021). Finding Potential Adverse Events in the Unstructured Text of Electronic Health Care Records: Development of the Shakespeare Method. JMIRx Med, 2(3), e27017. https://doi.org/10.2196/27017
Vancouver
Bright RA, Rankin SK, Dowdy K, Blok SV, Bright SJ, Palmer LAM. Finding Potential Adverse Events in the Unstructured Text of Electronic Health Care Records: Development of the Shakespeare Method. JMIRx Med. 2021;2(3):e27017. doi:10.2196/27017
BibTeX
@article{Bright2021,
author = {Bright, Roselie A and Rankin, Summer K and Dowdy, Katherine and Blok, Sergey V and Bright, Susan J and Palmer, Lee Anne M},
title = {Finding Potential Adverse Events in the Unstructured Text of Electronic Health Care Records: Development of the Shakespeare Method},
journal = {JMIRx Med},
year = {2021},
volume = {2},
number = {3},
pages = {e27017},
doi = {10.2196/27017}
}
EUVIMED