Autonomous navigation of catheters and guidewires in mechanical thrombectomy using inverse reinforcement learning
International Journal of Computer Assisted Radiology and Surgery · 2024
DOI: 10.1007/s11548-024-03208-w ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Computer Assisted Radiology and Surgery, 2024. Verfasst von Harry Robertshaw und 4 weiteren Autor:innen. Beteiligte Einrichtung: Surgical and Interventional Engineering, School of Biomedical Engineering and Imaging Sciences, Kings College London, London, UK. Hauptthemen laut MEDLINE: Thrombectomy. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Wellcome Trust, Engineering and Physical Sciences Research Council.
Abstract (Originalsprache)
Purpose
Autonomous navigation of catheters and guidewires can enhance endovascular surgery safety and efficacy, reducing procedure times and operator radiation exposure. Integrating tele-operated robotics could widen access to time-sensitive emergency procedures like mechanical thrombectomy (MT). Reinforcement learning (RL) shows potential in endovascular navigation, yet its application encounters challenges without a reward signal. This study explores the viability of autonomous guidewire navigation in MT vasculature using inverse reinforcement learning (IRL) to leverage expert demonstrations.
Methods
Employing the Simulation Open Framework Architecture (SOFA), this study established a simulation-based training and evaluation environment for MT navigation. We used IRL to infer reward functions from expert behaviour when navigating a guidewire and catheter. We utilized the soft actor-critic algorithm to train models with various reward functions and compared their performance in silico.
Results
We demonstrated feasibility of navigation using IRL. When evaluating single- versus dual-device (i.e. guidewire versus catheter and guidewire) tracking, both methods achieved high success rates of 95% and 96%, respectively. Dual tracking, however, utilized both devices mimicking an expert. A success rate of 100% and procedure time of 22.6 s were obtained when training with a reward function obtained through ‘reward shaping’. This outperformed a dense reward function (96%, 24.9 s) and an IRL-derived reward function (48%, 59.2 s).
Conclusions
We have contributed to the advancement of autonomous endovascular intervention navigation, particularly MT, by effectively employing IRL based on demonstrator expertise. The results underscore the potential of using reward shaping to efficiently train models, offering a promising avenue for enhancing the accessibility and precision of MT procedures. We envisage that future research can extend our methodology to diverse anatomical structures to enhance generalizability.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Surgical and Interventional Engineering, School of Biomedical Engineering and Imaging Sciences, Kings College London, London, UK.
- AIBE, Friedrich-Alexander University Erlangen-Nürnberg, Erlangen, Germany.
- Surgical and Interventional Engineering, School of Biomedical Engineering and Imaging Sciences, Kings College London, London, UK. thomas.booth@kcl.ac.uk.
- Department of Neuroradiology, Kings College Hospital, London, UK. thomas.booth@kcl.ac.uk.
Förderung
- Wellcome Trust
- Engineering and Physical Sciences Research Council
Zitieren
APA
Robertshaw, H., Karstensen, L., Jackson, B., Granados, A., & Booth, T. C. (2024). Autonomous navigation of catheters and guidewires in mechanical thrombectomy using inverse reinforcement learning. International Journal of Computer Assisted Radiology and Surgery. https://doi.org/10.1007/s11548-024-03208-w
Vancouver
Robertshaw H, Karstensen L, Jackson B, Granados A, Booth TC. Autonomous navigation of catheters and guidewires in mechanical thrombectomy using inverse reinforcement learning. International Journal of Computer Assisted Radiology and Surgery. 2024. doi:10.1007/s11548-024-03208-w
BibTeX
@article{Robertshaw2024,
author = {Robertshaw, Harry and Karstensen, Lennart and Jackson, Benjamin and Granados, Alejandro and Booth, Thomas C},
title = {Autonomous navigation of catheters and guidewires in mechanical thrombectomy using inverse reinforcement learning},
journal = {International Journal of Computer Assisted Radiology and Surgery},
year = {2024},
doi = {10.1007/s11548-024-03208-w}
}
EUVIMED