EUVIMEDEUVIMED entdecken
Crossref

Hierarchical reinforcement learning–based path planning for an endoscopic surgical robot

Shougang Sui, Zhiqi Liu, Jiabin Huang, Shizhan Luo, Xiuzhe Liu, Kun Li

Transactions of the Institute of Measurement and Control · 17.03.2026

DOI: 10.1177/01423312261429128 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Transactions of the Institute of Measurement and Control, online erschienen am 17.03.2026. Verfasst von Shougang Sui und 5 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 27 Literaturangaben. Gefördert von: shandong jianzhu university, Shandong Provincial Key Research and Development Program.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

With the rapid development of robotic and artificial intelligence technologies, the autonomous decision-making capability of endoscopic surgical robot has been significantly enhanced, accompanied by growing demands for automation in non-decision-making tasks. This study focuses on the path planning for complex tasks in surgical robot by proposing a hierarchical reinforcement learning (HRL) framework based on the option framework. Within this framework, the Semi-Markov Decision Process (SMDP) is extended into an augmented Markov Decision Process (MDP) to optimize termination conditions and facilitate long-horizon task training. To address the sparse reward problem, a hierarchical reward function is designed with intrinsic temporal rewards specifically implemented for high-level policies. In addition, a Type-Shared Option Policy (TSOP) is proposed to enhance training efficiency. Experimental results demonstrate that the proposed HRL framework effectively improves both the success rate and stability of path planning for surgical robot in the da Vinci Research Kit (dVRK) simulation environment.

Förderung

  • shandong jianzhu university
  • Shandong Provincial Key Research and Development Program

Zitieren

APA

Sui, S., Liu, Z., Huang, J., Luo, S., Liu, X., & Li, K. (2026). Hierarchical reinforcement learning–based path planning for an endoscopic surgical robot. Transactions of the Institute of Measurement and Control. https://doi.org/10.1177/01423312261429128

Vancouver

Sui S, Liu Z, Huang J, Luo S, Liu X, Li K. Hierarchical reinforcement learning–based path planning for an endoscopic surgical robot. Transactions of the Institute of Measurement and Control. 2026. doi:10.1177/01423312261429128

BibTeX
@article{Sui2026,
  author = {Sui, Shougang and Liu, Zhiqi and Huang, Jiabin and Luo, Shizhan and Liu, Xiuzhe and Li, Kun},
  title = {Hierarchical reinforcement learning–based path planning for an endoscopic surgical robot},
  journal = {Transactions of the Institute of Measurement and Control},
  year = {2026},
  doi = {10.1177/01423312261429128}
}
Kostenlos starten →