EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Autonomous countertraction for secure field of view in laparoscopic surgery using deep reinforcement learning

Yuriko Iyama, Yudai Takahashi, Jiahe Chen, Takumi Noda, Kazuaki Hara, Etsuko Kobayashi, Ichiro Sakuma, Naoki Tomii

International Journal of Computer Assisted Radiology and Surgery · 2024

DOI: 10.1007/s11548-024-03264-2 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Computer Assisted Radiology and Surgery, 2024. Verfasst von Yuriko Iyama und 7 weiteren Autor:innen. Beteiligte Einrichtung: Graduate School of Engineering, The University of Tokyo, Tokyo, Japan. Hauptthemen laut MEDLINE: Laparoscopy, Deep Learning. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 25 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Moonshot Research and Development Program, The University of Tokyo.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Purpose

Countertraction is a vital technique in laparoscopic surgery, stretching the tissue surface for incision and dissection. Due to the technical challenges and frequency of countertraction, autonomous countertraction has the potential to significantly reduce surgeons’ workload. Despite several methods proposed for automation, achieving optimal tissue visibility and tension for incision remains unrealized. Therefore, we propose a method for autonomous countertraction that enhances tissue surface planarity and visibility.

Methods

We constructed a neural network that integrates a point cloud convolutional neural network (CNN) with a deep reinforcement learning (RL) model. This network continuously controls the forceps position based on the surface shape observed by a camera and the forceps position. RL is conducted in a physical simulation environment, with verification experiments performed in both simulation and phantom environments. The evaluation was performed based on plane error, representing the average distance between the tissue surface and its least-squares plane, and angle error, indicating the angle between the tissue surface vector and the camera’s optical axis vector.

Results

The plane error decreased under all conditions both simulation and phantom environments, with 93.3% of case showing a reduction in angle error. In simulations, the plane error decreased from $$3.6 \pm 1.5{\text{ mm}}$$ 3.6 ± 1.5 mm to $$1.1 \pm 1.8 {\text{mm}}$$ 1.1 ± 1.8 mm , and the angle error from $$29 \pm 19 ^\circ$$ 29 ± 19 ∘ to $$14 \pm 13 ^\circ$$ 14 ± 13 ∘ . In the phantom environment, the plane error decreased from $$0.96 \pm 0.24{\text{ mm}}$$ 0.96 ± 0.24 mm to $$0.39 \pm 0.23 {\text{mm}}$$ 0.39 ± 0.23 mm , and the angle error from $$32 \pm 29 ^\circ$$ 32 ± 29 ∘ to $$17 \pm 20 ^\circ$$ 17 ± 20 ∘ .

Conclusion

The proposed neural network was validated in both simulation and phantom experimental settings, confirming that traction control improved tissue planarity and visibility. These results demonstrate the feasibility of automating countertraction using the proposed model.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

LaparoscopyDeep LearningHumansPhantoms, ImagingNeural Networks, ComputerComputer SimulationReinforcement Machine Learning

Stichwörter der Autor:innen

Autonomous manipulationComputer-assisted surgeryCountertractionMinimally invasive surgeryReinforcement learning

Autor:innen und Institutionen

  • Graduate School of Engineering, The University of Tokyo, Tokyo, Japan.
  • Graduate School of Engineering, The University of Tokyo, Tokyo, Japan. naoki_tomii@bmpe.t.u-tokyo.ac.jp.

Förderung

  • Moonshot Research and Development Program
  • The University of Tokyo

Zitieren

APA

Iyama, Y., Takahashi, Y., Chen, J., Noda, T., Hara, K., Kobayashi, E., Sakuma, I., & Tomii, N. (2024). Autonomous countertraction for secure field of view in laparoscopic surgery using deep reinforcement learning. International Journal of Computer Assisted Radiology and Surgery. https://doi.org/10.1007/s11548-024-03264-2

Vancouver

Iyama Y, Takahashi Y, Chen J, Noda T, Hara K, Kobayashi E, et al. Autonomous countertraction for secure field of view in laparoscopic surgery using deep reinforcement learning. International Journal of Computer Assisted Radiology and Surgery. 2024. doi:10.1007/s11548-024-03264-2

BibTeX
@article{Iyama2024,
  author = {Iyama, Yuriko and Takahashi, Yudai and Chen, Jiahe and Noda, Takumi and Hara, Kazuaki and Kobayashi, Etsuko and Sakuma, Ichiro and Tomii, Naoki},
  title = {Autonomous countertraction for secure field of view in laparoscopic surgery using deep reinforcement learning},
  journal = {International Journal of Computer Assisted Radiology and Surgery},
  year = {2024},
  doi = {10.1007/s11548-024-03264-2}
}
Kostenlos starten →