Intuition-guided Reinforcement Learning for Soft Tissue Manipulation with Unknown Constraints
Cyborg and Bionic Systems · 01.01.2025 · 6
DOI: 10.34133/cbsystems.0114 ↗Kurz gefasst
Fachartikel in der Zeitschrift Cyborg and Bionic Systems, online erschienen am 14.04.2025. Verfasst von Xian He und 5 weiteren Autor:innen. Beteiligte Einrichtung: School of Management, Hefei University of Technology, Hefei, China. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 30 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: the Young Scientists Fund of the National Natural Science Foundation of China, the National Key Research and Development Program of China, the Joint Funds Program of the National Natural Science Foundation of China.
Abstract (Originalsprache)
Intraoperative soft tissue manipulation is a critical challenge in autonomous robotic surgery. Furthermore, the intricate in vivo environment surrounding the target soft tissues poses additional hindrances to autonomous robotic decision-making. Previous studies assumed the grasping point was known and the target deformation could be achieved. The constraints were assumed to be constant during the operation, and there were no obstacles around the soft tissue. To address these problems, an intuition-guided deep reinforcement learning framework based on soft actor-critic (ID-SAC) was proposed for soft tissue manipulation under unknown constraints. The SAC algorithm is automatically activated upon encountering an obstacle, and the designed intuitive manipulation (IM) strategy is used to pull soft tissues toward the target shape directly when the obstacle is distant. A regulator factor is designed as an action within this framework to coordinate the IM approach and the SAC network. A reward function is designed to balance the exploration and exploitation of large deformations. Simultaneously, we proposed an autonomous grasp point selection neural network to prevent the impractical selection of grasp points, ensuring they can reach the target while avoiding grasping lesions and constrained areas. Successful simulation results confirmed that the proposed framework can manipulate the soft tissue while avoiding obstacles and adding new positional constraints. Compared with the SAC algorithm, the proposed framework can markedly increase the robotic soft tissue manipulation ability by automatically adjusting the regulator factors.
Autor:innen und Institutionen
- School of Management, Hefei University of Technology, Hefei, China.
- Key Laboratory of Process Optimization and Intelligent Decision-Making (Ministry of Education), Hefei University of Technology, Hefei, China.
- Faculty of Urology, Third Medical Center, Chinese PLA General Hospital, Beijing, China.
- Independent Researcher, San Jose, CA, USA.
ORCID-Profile: Shuai Zhang, Tongyu Jia, Bo Ouyang
Förderung
- the Young Scientists Fund of the National Natural Science Foundation of China
- the National Key Research and Development Program of China
- the Joint Funds Program of the National Natural Science Foundation of China
- the Basic Science Centre Program of the National Natural Science Foundation of China
Zitieren
APA
He, X., Zhang, S., Chu, J., Jia, T., Yu, L., & Ouyang, B. (2025). Intuition-guided Reinforcement Learning for Soft Tissue Manipulation with Unknown Constraints. Cyborg and Bionic Systems, 6. https://doi.org/10.34133/cbsystems.0114
Vancouver
He X, Zhang S, Chu J, Jia T, Yu L, Ouyang B. Intuition-guided Reinforcement Learning for Soft Tissue Manipulation with Unknown Constraints. Cyborg and Bionic Systems. 2025;6. doi:10.34133/cbsystems.0114
BibTeX
@article{He2025,
author = {He, Xian and Zhang, Shuai and Chu, Jian and Jia, Tongyu and Yu, Lantao and Ouyang, Bo},
title = {Intuition-guided Reinforcement Learning for Soft Tissue Manipulation with Unknown Constraints},
journal = {Cyborg and Bionic Systems},
year = {2025},
volume = {6},
doi = {10.34133/cbsystems.0114}
}
EUVIMED