Enhancing critical view of safety recognition using vision foundation models and state-space temporal modeling
International Journal of Computer Assisted Radiology and Surgery · 17.08.2026
DOI: 10.1007/s11548-026-03748-3 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Computer Assisted Radiology and Surgery, online erschienen am 17.08.2026. Verfasst von Rui Guo und 3 weiteren Autor:innen. Beteiligte Einrichtung: Digital Solutions, Intuitive Surgical, 5655 Spalding Drive, Peachtree Corners, GA, 30092, USA. rui.guo@intusurg.com. Die Arbeit nennt 29 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Purpose
The Critical View of Safety (CVS) is a clinically mandated criterion for reducing bile duct injury during laparoscopic cholecystectomy; however, its automated recognition from endoscopic video remains challenging due to visual occlusion, depth ambiguity, and the inherently progressive nature of CVS formation across time. This work aims to develop a robust and clinically interpretable framework for automated multi-label CVS recognition from monocular surgical video, without relying on auxiliary segmentation supervision or stereo hardware.
Methods
We propose a novel spatio-temporal CVS recognition framework that integrates depth-augmented visual representations with efficient temporal state-space modeling. The approach employs a DINOv2-based vision foundation model extended to RGB-D input for robust self-supervised spatial representation learning, alongside a Swin Transformer for hierarchical and anatomically localized feature encoding. To capture the temporal persistence and geometric consistency required for CVS identification, a depth-aware Spatio-temporal Mamba module is introduced to model long-range temporal dependencies with linear computational complexity. The network produces multi-label predictions corresponding to individual CVS criteria.
Results
Experimental evaluations demonstrate that the proposed RGB-D spatio-temporal architecture consistently outperforms RGB-only and attention-based temporal baselines. The method shows improved robustness to visual occlusion, viewpoint variation, and dataset shift across evaluation scenarios.
Conclusion
The proposed RGB-D spatio-temporal framework demonstrates that integrating weight-inflated foundation model adaptation, hierarchical spatial encoding, and depth-conditioned selective state-space temporal modeling yields reliable, scalable, and clinically interpretable CVS recognition. In contrast to prior video SSM approaches that process homogeneous RGB token sequences, the depth-aware gating and dual-encoder fusion introduced here provide targeted inductive biases suited to the geometric and temporal demands of surgical safety verification.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Digital Solutions, Intuitive Surgical, 5655 Spalding Drive, Peachtree Corners, GA, 30092, USA. rui.guo@intusurg.com.
- Digital Solutions, Intuitive Surgical, 5655 Spalding Drive, Peachtree Corners, GA, 30092, USA.
Zitieren
APA
Guo, R., Mueller, B., Zhang, X., & Liu, X. (2026). Enhancing critical view of safety recognition using vision foundation models and state-space temporal modeling. International Journal of Computer Assisted Radiology and Surgery. https://doi.org/10.1007/s11548-026-03748-3
Vancouver
Guo R, Mueller B, Zhang X, Liu X. Enhancing critical view of safety recognition using vision foundation models and state-space temporal modeling. International Journal of Computer Assisted Radiology and Surgery. 2026. doi:10.1007/s11548-026-03748-3
BibTeX
@article{Guo2026,
author = {Guo, Rui and Mueller, Benjamin and Zhang, Xiaorui and Liu, Xi},
title = {Enhancing critical view of safety recognition using vision foundation models and state-space temporal modeling},
journal = {International Journal of Computer Assisted Radiology and Surgery},
year = {2026},
doi = {10.1007/s11548-026-03748-3}
}
EUVIMED