EUVIMEDEUVIMED entdecken
Open Access

Intuition-guided Reinforcement Learning for Soft Tissue Manipulation with Unknown Constraints

Xian He, Shuai Zhang iD, Jian Chu, Tongyu Jia iD, Lantao Yu, Bo Ouyang iD

Cyborg and Bionic Systems · 01.01.2025 · 6

DOI: 10.34133/cbsystems.0114 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Cyborg and Bionic Systems, online erschienen am 14.04.2025. Verfasst von Xian He und 5 weiteren Autor:innen. Beteiligte Einrichtung: School of Management, Hefei University of Technology, Hefei, China. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 30 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: the Young Scientists Fund of the National Natural Science Foundation of China, the National Key Research and Development Program of China, the Joint Funds Program of the National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Intraoperative soft tissue manipulation is a critical challenge in autonomous robotic surgery. Furthermore, the intricate in vivo environment surrounding the target soft tissues poses additional hindrances to autonomous robotic decision-making. Previous studies assumed the grasping point was known and the target deformation could be achieved. The constraints were assumed to be constant during the operation, and there were no obstacles around the soft tissue. To address these problems, an intuition-guided deep reinforcement learning framework based on soft actor-critic (ID-SAC) was proposed for soft tissue manipulation under unknown constraints. The SAC algorithm is automatically activated upon encountering an obstacle, and the designed intuitive manipulation (IM) strategy is used to pull soft tissues toward the target shape directly when the obstacle is distant. A regulator factor is designed as an action within this framework to coordinate the IM approach and the SAC network. A reward function is designed to balance the exploration and exploitation of large deformations. Simultaneously, we proposed an autonomous grasp point selection neural network to prevent the impractical selection of grasp points, ensuring they can reach the target while avoiding grasping lesions and constrained areas. Successful simulation results confirmed that the proposed framework can manipulate the soft tissue while avoiding obstacles and adding new positional constraints. Compared with the SAC algorithm, the proposed framework can markedly increase the robotic soft tissue manipulation ability by automatically adjusting the regulator factors.

Autor:innen und Institutionen

  • School of Management, Hefei University of Technology, Hefei, China.
  • Key Laboratory of Process Optimization and Intelligent Decision-Making (Ministry of Education), Hefei University of Technology, Hefei, China.
  • Faculty of Urology, Third Medical Center, Chinese PLA General Hospital, Beijing, China.
  • Independent Researcher, San Jose, CA, USA.

ORCID-Profile: Shuai Zhang, Tongyu Jia, Bo Ouyang

Förderung

  • the Young Scientists Fund of the National Natural Science Foundation of China
  • the National Key Research and Development Program of China
  • the Joint Funds Program of the National Natural Science Foundation of China
  • the Basic Science Centre Program of the National Natural Science Foundation of China

Zitieren

APA

He, X., Zhang, S., Chu, J., Jia, T., Yu, L., & Ouyang, B. (2025). Intuition-guided Reinforcement Learning for Soft Tissue Manipulation with Unknown Constraints. Cyborg and Bionic Systems, 6. https://doi.org/10.34133/cbsystems.0114

Vancouver

He X, Zhang S, Chu J, Jia T, Yu L, Ouyang B. Intuition-guided Reinforcement Learning for Soft Tissue Manipulation with Unknown Constraints. Cyborg and Bionic Systems. 2025;6. doi:10.34133/cbsystems.0114

BibTeX
@article{He2025,
  author = {He, Xian and Zhang, Shuai and Chu, Jian and Jia, Tongyu and Yu, Lantao and Ouyang, Bo},
  title = {Intuition-guided Reinforcement Learning for Soft Tissue Manipulation with Unknown Constraints},
  journal = {Cyborg and Bionic Systems},
  year = {2025},
  volume = {6},
  doi = {10.34133/cbsystems.0114}
}
Kostenlos starten →