EUVIMEDEUVIMED entdecken
Open Access

Strategies and Considerations for Safe Reinforcement Learning in Programming Cardiac Implantable Electronic Devices

John Komp, Aaptha Boggaram, David P Kao, Ashutosh Trivedi, Michael A Rosenberg

Medical Research Archives · 2025 · 13 (3)

DOI: 10.18103/mra.v13i3.6363 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Medical Research Archives, 2025. Verfasst von John Komp und 4 weiteren Autor:innen. Beteiligte Einrichtung: College of Engineering and Applied Science, University of Colorado, Boulder, CO, USA. Die Arbeit wurde bisher 7-mal zitiert (Crossref). Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: NHLBI NIH HHS.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The programming of cardiac implantable electronic devices, such as pacemakers and implantable defibrillators, represents a promising domain for the application of automated learning systems. These systems, leveraging a type of artificial intelligence called reinforcement learning, have the potential to personalize medical treatment by adapting device settings based on an individual’s physiological responses. At the core of these self-learning algorithms is the principle of balancing exploration and exploitation. Exploitation refers to the selection of device programming settings previously demonstrated to provide clinical benefit, while exploration refers to the real-time search for adjustments to device programming that could provide an improvement in clinical outcomes for each individual. Exploration is a critical component of the reinforcement learning algorithm, and provides the opportunity to identify settings that could directly benefit individual patients. However, unconstrained exploration poses risks, as an automated change in certain settings may lead to adverse clinical outcomes. To mitigate these risks, several strategies have been proposed to ensure that algorithm-driven programming changes achieve the desired level of individualized optimization without compromising patient safety. In this review, we examine the existing literature on safe reinforcement learning algorithms in automated systems and discuss their potential application to the programming of cardiac implantable electronic devices.

Autor:innen und Institutionen

  • College of Engineering and Applied Science, University of Colorado, Boulder, CO, USA.
  • Division of Cardiology, University of Colorado Anschutz Medical Campus, Aurora, CO, USA.

Förderung

  • NHLBI NIH HHS

Zitieren

APA

Komp, J., Boggaram, A., Kao, D. P., Trivedi, A., & Rosenberg, M. A. (2025). Strategies and Considerations for Safe Reinforcement Learning in Programming Cardiac Implantable Electronic Devices. Medical Research Archives, 13(3). https://doi.org/10.18103/mra.v13i3.6363

Vancouver

Komp J, Boggaram A, Kao DP, Trivedi A, Rosenberg MA. Strategies and Considerations for Safe Reinforcement Learning in Programming Cardiac Implantable Electronic Devices. Medical Research Archives. 2025;13(3). doi:10.18103/mra.v13i3.6363

BibTeX
@article{Komp2025,
  author = {Komp, John and Boggaram, Aaptha and Kao, David P and Trivedi, Ashutosh and Rosenberg, Michael A},
  title = {Strategies and Considerations for Safe Reinforcement Learning in Programming Cardiac Implantable Electronic Devices},
  journal = {Medical Research Archives},
  year = {2025},
  volume = {13},
  number = {3},
  doi = {10.18103/mra.v13i3.6363}
}
Kostenlos starten →