Diagnostic suspicion bias and machine learning: Breaking the awareness deadlock for sepsis detection
PLOS Digital Health · 01.11.2023 · 2 (11) · e0000365
DOI: 10.1371/journal.pdig.0000365 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS Digital Health, online erschienen am 01.11.2023. Verfasst von Varesh Prasad und 11 weiteren Autor:innen. Beteiligte Einrichtung: Harvard-MIT Program in Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, Massachusetts, United States of America. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 32 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Defense Science and Engineering Graduate Fellowship, MIT-MGH Strategic Grand Challenge Partnership, CRICO Risk Management Foundation.
Abstract (Originalsprache)
Many early warning algorithms are downstream of clinical evaluation and diagnostic testing, which means that they may not be useful when clinicians fail to suspect illness and fail to order appropriate tests. Depending on how such algorithms handle missing data, they could even indicate “low risk” simply because the testing data were never ordered. We considered predictive methodologies to identify sepsis at triage, before diagnostic tests are ordered, in a busy Emergency Department (ED). One algorithm used “bland clinical data” (data available at triage for nearly every patient). The second algorithm added three yes/no questions to be answered after the triage interview. Retrospectively, we studied adult patients from a single ED between 2014–16, separated into training (70%) and testing (30%) cohorts, and a final validation cohort of patients from four EDs between 2016–2018. Sepsis was defined per the Rhee criteria. Investigational predictors were demographics and triage vital signs (downloaded from the hospital EMR); past medical history; and the auxiliary queries (answered by chart reviewers who were blinded to all data except the triage note and initial HPI). We developed L2-regularized logistic regression models using a greedy forward feature selection. There were 1164, 499, and 784 patients in the training, testing, and validation cohorts, respectively. The bland clinical data model yielded ROC AUC’s 0.78 (0.76–0.81) and 0.77 (0.73–0.81), for training and testing, respectively, and ranged from 0.74–0.79 in four hospital validation. The second model which included auxiliary queries yielded 0.84 (0.82–0.87) and 0.83 (0.79–0.86), and ranged from 0.78–0.83 in four hospital validation. The first algorithm did not require clinician input but yielded middling performance. The second showed a trend towards superior performance, though required additional user effort. These methods are alternatives to predictive algorithms downstream of clinical evaluation and diagnostic testing. For hospital early warning algorithms, consideration should be given to bias and usability of various methods.
Autor:innen und Institutionen
- Harvard-MIT Program in Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, Massachusetts, United States of America.
- Institute for Medical Engineering and Science, Massachusetts Institute of Technology, Cambridge, Massachusetts, United States of America.
- Department of Emergency Medicine, Massachusetts General Hospital, Boston, Massachusetts, United States of America.
- Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, Cambridge, Massachusetts, United States of America.
ORCID-Profile: Varesh Prasad, Iain E Kehoe, Brett Biebelberg, Yang Wang, James C Lynch, Michael R Filbin
Förderung
- National Defense Science and Engineering Graduate Fellowship
- MIT-MGH Strategic Grand Challenge Partnership
- CRICO Risk Management Foundation
- Nihon Kohden Corporation
Zitieren
APA
Prasad, V., Aydemir, B., Kehoe, I. E., Kotturesh, C., O'Connell, A., Biebelberg, B., Wang, Y., Lynch, J. C., Pepino, J. A., Filbin, M. R., Heldt, T., & Reisner, A. T. (2023). Diagnostic suspicion bias and machine learning: Breaking the awareness deadlock for sepsis detection. PLOS Digital Health, 2(11), e0000365. https://doi.org/10.1371/journal.pdig.0000365
Vancouver
Prasad V, Aydemir B, Kehoe IE, Kotturesh C, O'Connell A, Biebelberg B, et al. Diagnostic suspicion bias and machine learning: Breaking the awareness deadlock for sepsis detection. PLOS Digital Health. 2023;2(11):e0000365. doi:10.1371/journal.pdig.0000365
BibTeX
@article{Prasad2023,
author = {Prasad, Varesh and Aydemir, Baturay and Kehoe, Iain E and Kotturesh, Chaya and O'Connell, Abigail and Biebelberg, Brett and Wang, Yang and Lynch, James C and Pepino, Jeremy A and Filbin, Michael R and Heldt, Thomas and Reisner, Andrew T},
title = {Diagnostic suspicion bias and machine learning: Breaking the awareness deadlock for sepsis detection},
journal = {PLOS Digital Health},
year = {2023},
volume = {2},
number = {11},
pages = {e0000365},
doi = {10.1371/journal.pdig.0000365}
}
EUVIMED