Deep Reinforcement Learning-Based Robotic Puncturing Path Planning of Flexible Needle
Processes · 12.12.2024 · 12 (12) · 2852
DOI: 10.3390/pr12122852 ↗Kurz gefasst
Fachartikel in der Zeitschrift Processes, online erschienen am 12.12.2024. Verfasst von Jun Lin und 4 weiteren Autor:innen. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 29 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Science and Technology Planning Project of Guangdong Province of China, Outstanding Youth Fund of Guangdong Province, Science and Technology Program of Guangzhou, China.
Abstract (Originalsprache)
The path planning of flexible needles in robotic puncturing presents challenges such as limited model accuracy and poor real-time performance, which affect both efficiency and accuracy in complex medical scenarios. To address these issues, this paper proposes a deep reinforcement learning-based path planning method for flexible needles in robotic puncturing. Firstly, we introduce a unicycle model to describe needle motion and design a hierarchical model to simulate layered tissue interactions with the needle. The forces exerted by tissues at different positions on the flexible needle are considered, achieving a combination of kinematic and mechanical models. Secondly, a deep reinforcement learning framework is built, integrating obstacle avoidance and target attraction to optimize path planning. The design of state features, the action space, and the reward function is tailored to enhance the model’s decision-making capabilities. Moreover, we incorporate a retraction mechanism to bolster the system’s adaptability and robustness in the dynamic context of surgical procedures. Finally, laparotomy simulation results validate the proposed method’s effectiveness and generalizability, demonstrating its superiority over current state-of-the-art techniques in robotic puncturing.
Förderung
- Science and Technology Planning Project of Guangdong Province of China
- Outstanding Youth Fund of Guangdong Province
- Science and Technology Program of Guangzhou, China
Zitieren
APA
Lin, J., Huang, Z., Zhu, T., Leng, J., & Huang, K. (2024). Deep Reinforcement Learning-Based Robotic Puncturing Path Planning of Flexible Needle. Processes, 12(12), 2852. https://doi.org/10.3390/pr12122852
Vancouver
Lin J, Huang Z, Zhu T, Leng J, Huang K. Deep Reinforcement Learning-Based Robotic Puncturing Path Planning of Flexible Needle. Processes. 2024;12(12):2852. doi:10.3390/pr12122852
BibTeX
@article{Lin2024,
author = {Lin, Jun and Huang, Zhiqiang and Zhu, Tengliang and Leng, Jiewu and Huang, Kai},
title = {Deep Reinforcement Learning-Based Robotic Puncturing Path Planning of Flexible Needle},
journal = {Processes},
year = {2024},
volume = {12},
number = {12},
pages = {2852},
doi = {10.3390/pr12122852}
}
EUVIMED