Self-Supervised Cyclic Diffeomorphic Mapping for Soft Tissue Deformation Recovery in Robotic Surgery Scenes
IEEE Transactions on Medical Imaging · 2024
DOI: 10.1109/tmi.2024.3439701 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Medical Imaging, 2024. Verfasst von Shizhan Gong und 7 weiteren Autor:innen. Hauptthemen laut MEDLINE: Robotic Surgical Procedures, Imaging, Three-Dimensional, Supervised Machine Learning. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 74 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Research Grants Council of the Hong Kong Special Administrative Region, China, National Natural Science Foundation of China, Cornerstone Robotics Ltd.
Abstract (Originalsprache)
The ability to recover tissue deformation from surgical video is fundamental for many downstream applications in robotic surgery. Despite noticeable advancements, this task remains under-explored due to the complex dynamics of soft tissues manipulated by surgical instruments. Achieving dense and accurate tissue tracking is further complicated by ambiguous pixel correspondence in regions with homogeneous texture. In this paper, we introduce a novel self-supervised framework to recover tissue deformations from stereo surgical videos. Our approach integrates semantics, cross-frame motion flow, and long-range temporal dependencies to accurately represent tissue dynamics for deformation recovery. Moreover, we incorporate diffeomorphic mapping to regularize the warping field to be physically more realistic. To comprehensively evaluate our method, we collected stereo surgical video clips containing three types of tissue manipulation (i.e., pushing, dissection and retraction) from two surgical procedures (i.e., hemicolectomy and mesorectal excision). Our method demonstrates promising results in capturing tissue 3D deformation, and generalizes well across different actions and procedures. It also outperforms current state-of-the-art approaches based on non-rigid registration and optical flow estimation. To the best of our knowledge, this is the first work on self-supervised learning for dense tissue deformation modeling from stereo surgical videos. The paper's code is available at: https://github.com/ med-air/RecoverTissueDeform.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Förderung
- Research Grants Council of the Hong Kong Special Administrative Region, China
- National Natural Science Foundation of China
- Cornerstone Robotics Ltd
Zitieren
APA
Gong, S., Long, Y., Chen, K., Liu, J., Xiao, Y., Cheng, A., Wang, Z., & Dou, Q. (2024). Self-Supervised Cyclic Diffeomorphic Mapping for Soft Tissue Deformation Recovery in Robotic Surgery Scenes. IEEE Transactions on Medical Imaging. https://doi.org/10.1109/tmi.2024.3439701
Vancouver
Gong S, Long Y, Chen K, Liu J, Xiao Y, Cheng A, et al. Self-Supervised Cyclic Diffeomorphic Mapping for Soft Tissue Deformation Recovery in Robotic Surgery Scenes. IEEE Transactions on Medical Imaging. 2024. doi:10.1109/tmi.2024.3439701
BibTeX
@article{Gong2024,
author = {Gong, Shizhan and Long, Yonghao and Chen, Kai and Liu, Jiaqi and Xiao, Yuliang and Cheng, Alexis and Wang, Zerui and Dou, Qi},
title = {Self-Supervised Cyclic Diffeomorphic Mapping for Soft Tissue Deformation Recovery in Robotic Surgery Scenes},
journal = {IEEE Transactions on Medical Imaging},
year = {2024},
doi = {10.1109/tmi.2024.3439701}
}
EUVIMED