Reinforcement learning informs optimal treatment strategies to limit antibiotic resistance
Proceedings of the National Academy of Sciences · 16.04.2024 · 121 (16)
DOI: 10.1073/pnas.2303165121 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the National Academy of Sciences, online erschienen am 12.04.2024. Verfasst von Davis T Weaver und 3 weiteren Autor:innen. Beteiligte Einrichtung: Case Western Reserve University School of Medicine, Cleveland, OH 44106. Hauptthemen laut MEDLINE: Learning, Anti-Infective Agents. Die Arbeit wurde bisher 56-mal zitiert (Crossref) und nennt 60 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: NCI NIH HHS, NIGMS NIH HHS, HHS | National Institutes of Health.
Abstract (Originalsprache)
Antimicrobial resistance was estimated to be associated with 4.95 million deaths worldwide in 2019. It is possible to frame the antimicrobial resistance problem as a feedback-control problem. If we could optimize this feedback-control problem and translate our findings to the clinic, we could slow, prevent, or reverse the development of high-level drug resistance. Prior work on this topic has relied on systems where the exact dynamics and parameters were known a priori. In this study, we extend this work using a reinforcement learning (RL) approach capable of learning effective drug cycling policies in a system defined by empirically measured fitness landscapes. Crucially, we show that it is possible to learn effective drug cycling policies despite the problems of noisy, limited, or delayed measurement. Given access to a panel of 15 β -lactam antibiotics with which to treat the simulated Escherichia coli population, we demonstrate that RL agents outperform two naive treatment paradigms at minimizing the population fitness over time. We also show that RL agents approach the performance of the optimal drug cycling policy. Even when stochastic noise is introduced to the measurements of population fitness, we show that RL agents are capable of maintaining evolving populations at lower growth rates compared to controls. We further tested our approach in arbitrary fitness landscapes of up to 1,024 genotypes. We show that minimization of population fitness using drug cycles is not limited by increasing genome size. Our work represents a proof-of-concept for using AI to control complex evolutionary processes.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Substanzen
Autor:innen und Institutionen
- Case Western Reserve University School of Medicine, Cleveland, OH 44106.
- Translational Hematology Oncology Research, Cleveland Clinic, Cleveland, OH 44106.
- Department of Physics, Case Western Reserve University, Cleveland, OH 44106.
ORCID-Profile: Davis T Weaver, Eshan S King, Jacob G Scott
Förderung
- NCI NIH HHS
- NIGMS NIH HHS
- HHS | National Institutes of Health
Zitieren
APA
Weaver, D. T., King, E. S., Maltas, J., & Scott, J. G. (2024). Reinforcement learning informs optimal treatment strategies to limit antibiotic resistance. Proceedings of the National Academy of Sciences, 121(16). https://doi.org/10.1073/pnas.2303165121
Vancouver
Weaver DT, King ES, Maltas J, Scott JG. Reinforcement learning informs optimal treatment strategies to limit antibiotic resistance. Proceedings of the National Academy of Sciences. 2024;121(16). doi:10.1073/pnas.2303165121
BibTeX
@article{Weaver2024,
author = {Weaver, Davis T and King, Eshan S and Maltas, Jeff and Scott, Jacob G},
title = {Reinforcement learning informs optimal treatment strategies to limit antibiotic resistance},
journal = {Proceedings of the National Academy of Sciences},
year = {2024},
volume = {121},
number = {16},
doi = {10.1073/pnas.2303165121}
}
EUVIMED