EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Self-Supervised Cyclic Diffeomorphic Mapping for Soft Tissue Deformation Recovery in Robotic Surgery Scenes

Shizhan Gong, Yonghao Long, Kai Chen, Jiaqi Liu, Yuliang Xiao, Alexis Cheng, Zerui Wang, Qi Dou

IEEE Transactions on Medical Imaging · 2024

DOI: 10.1109/tmi.2024.3439701 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Medical Imaging, 2024. Verfasst von Shizhan Gong und 7 weiteren Autor:innen. Hauptthemen laut MEDLINE: Robotic Surgical Procedures, Imaging, Three-Dimensional, Supervised Machine Learning. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 74 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Research Grants Council of the Hong Kong Special Administrative Region, China, National Natural Science Foundation of China, Cornerstone Robotics Ltd.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The ability to recover tissue deformation from surgical video is fundamental for many downstream applications in robotic surgery. Despite noticeable advancements, this task remains under-explored due to the complex dynamics of soft tissues manipulated by surgical instruments. Achieving dense and accurate tissue tracking is further complicated by ambiguous pixel correspondence in regions with homogeneous texture. In this paper, we introduce a novel self-supervised framework to recover tissue deformations from stereo surgical videos. Our approach integrates semantics, cross-frame motion flow, and long-range temporal dependencies to accurately represent tissue dynamics for deformation recovery. Moreover, we incorporate diffeomorphic mapping to regularize the warping field to be physically more realistic. To comprehensively evaluate our method, we collected stereo surgical video clips containing three types of tissue manipulation (i.e., pushing, dissection and retraction) from two surgical procedures (i.e., hemicolectomy and mesorectal excision). Our method demonstrates promising results in capturing tissue 3D deformation, and generalizes well across different actions and procedures. It also outperforms current state-of-the-art approaches based on non-rigid registration and optical flow estimation. To the best of our knowledge, this is the first work on self-supervised learning for dense tissue deformation modeling from stereo surgical videos. The paper's code is available at: https://github.com/ med-air/RecoverTissueDeform.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Robotic Surgical ProceduresImaging, Three-DimensionalSupervised Machine LearningHumansAlgorithmsVideo Recording

Förderung

  • Research Grants Council of the Hong Kong Special Administrative Region, China
  • National Natural Science Foundation of China
  • Cornerstone Robotics Ltd

Zitieren

APA

Gong, S., Long, Y., Chen, K., Liu, J., Xiao, Y., Cheng, A., Wang, Z., & Dou, Q. (2024). Self-Supervised Cyclic Diffeomorphic Mapping for Soft Tissue Deformation Recovery in Robotic Surgery Scenes. IEEE Transactions on Medical Imaging. https://doi.org/10.1109/tmi.2024.3439701

Vancouver

Gong S, Long Y, Chen K, Liu J, Xiao Y, Cheng A, et al. Self-Supervised Cyclic Diffeomorphic Mapping for Soft Tissue Deformation Recovery in Robotic Surgery Scenes. IEEE Transactions on Medical Imaging. 2024. doi:10.1109/tmi.2024.3439701

BibTeX
@article{Gong2024,
  author = {Gong, Shizhan and Long, Yonghao and Chen, Kai and Liu, Jiaqi and Xiao, Yuliang and Cheng, Alexis and Wang, Zerui and Dou, Qi},
  title = {Self-Supervised Cyclic Diffeomorphic Mapping for Soft Tissue Deformation Recovery in Robotic Surgery Scenes},
  journal = {IEEE Transactions on Medical Imaging},
  year = {2024},
  doi = {10.1109/tmi.2024.3439701}
}
Kostenlos starten →