External validation of predictive models for antibiotic susceptibility of urine culture
BJU International · 2025-04 · 135 (4) · 629-637
DOI: 10.1111/bju.16626 ↗Kurz gefasst
Validierungsstudie in der Zeitschrift BJU International, online erschienen am 22.12.2024. Verfasst von Glenn T Werneburg und 9 weiteren Autor:innen. Beteiligte Einrichtung: Department of Urology, Glickman Urological Institute, Cleveland Clinic Foundation, Cleveland, OH, USA. Hauptthemen laut MEDLINE: Anti-Bacterial Agents, Machine Learning, Urinary Tract Infections. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 24 Literaturangaben.
Abstract (Originalsprache)
Objective
To develop, externally validate, and test a series of computer algorithms to accurately predict antibiotic susceptibility test (AST) results at the time of clinical diagnosis, up to 3 days before standard urine culture results become available, with the goal of improving antibiotic stewardship and patient outcomes. Patients and Methods Machine learning algorithms were developed and trained to predict susceptibility or resistance using over 4.7 million discrete AST classifications from urine cultures in a cohort of adult patients from outpatient and inpatient settings from 2012 to 2022. The algorithms were validated on a cohort from a geographically‐distant hospital system, ~1931 km (~1200 miles) from the training cohort facilities, from the same time period. Finally, algorithms were clinically validated in a contemporary cohort and compared to the empiric therapy prescribed by clinicians. Appropriateness of the antibiotics selected by clinicians and the algorithm during the clinical validation was compared.
Results
Algorithms were accurate during clinical validation (area under the receiver operating characteristic curve [AUC] 0.71–0.94) for all 11 tested antibiotics. The algorithms’ accuracy improved as the organism was identified (AUC 0.79–0.97). In external validation in a geographically‐distant cohort, the algorithms remained accurate even without additional training on this group (AUC 0.69–0.87). When the algorithms were trained on the antibiogram from the geographically‐distant hospital, the accuracy improved (AUC 0.70–0.93). When algorithms’ performances were tested against clinicians in a contemporary cohort for the empiric prescription of oral antibiotics, the drug agent suggested by the algorithms more frequently resulted in adequate empiric coverage.
Conclusions
Machine learning algorithms trained on a large dataset are accurate in prediction of urine culture susceptibility vs resistance up to 3 days prior to urine AST availability. Clinical implementation of such an algorithm could improve both clinical care and antimicrobial stewardship.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Substanzen
Autor:innen und Institutionen
- Department of Urology, Glickman Urological Institute, Cleveland Clinic Foundation, Cleveland, OH, USA.
- Department of Pathology and Laboratory Medicine, Cleveland Clinic Foundation, Cleveland, OH, USA.
- Cleveland Clinic Lerner College of Medicine, Case Western Reserve University, Cleveland, OH, USA.
- Infection Biology Program, Lerner Research Institute, Cleveland Clinic, Cleveland, OH, USA.
- Department of Quantitative Health Sciences, Lerner Research Institute, Cleveland Clinic, Cleveland, OH, USA.
ORCID-Profile: Glenn T Werneburg
Zitieren
APA
Werneburg, G. T., Rhoads, D. D., Milinovich, A., McSweeney, S., Knorr, J., Mourany, L., Zajichek, A., Goldman, H. B., Haber, G. P., & Vasavada, S. P. (2025). External validation of predictive models for antibiotic susceptibility of urine culture. BJU International, 135(4), 629-637. https://doi.org/10.1111/bju.16626
Vancouver
Werneburg GT, Rhoads DD, Milinovich A, McSweeney S, Knorr J, Mourany L, et al. External validation of predictive models for antibiotic susceptibility of urine culture. BJU International. 2025;135(4):629-637. doi:10.1111/bju.16626
BibTeX
@article{Werneburg2025,
author = {Werneburg, Glenn T and Rhoads, Daniel D and Milinovich, Alex and McSweeney, Sean and Knorr, Jacob and Mourany, Lyla and Zajichek, Alex and Goldman, Howard B and Haber, Georges-Pascal and Vasavada, Sandip P},
title = {External validation of predictive models for antibiotic susceptibility of urine culture},
journal = {BJU International},
year = {2025},
volume = {135},
number = {4},
pages = {629--637},
doi = {10.1111/bju.16626}
}
EUVIMED