EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Enhancing critical view of safety recognition using vision foundation models and state-space temporal modeling

Rui Guo, Benjamin Mueller, Xiaorui Zhang, Xi Liu

International Journal of Computer Assisted Radiology and Surgery · 17.08.2026

DOI: 10.1007/s11548-026-03748-3 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Computer Assisted Radiology and Surgery, online erschienen am 17.08.2026. Verfasst von Rui Guo und 3 weiteren Autor:innen. Beteiligte Einrichtung: Digital Solutions, Intuitive Surgical, 5655 Spalding Drive, Peachtree Corners, GA, 30092, USA. rui.guo@intusurg.com. Die Arbeit nennt 29 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Purpose

The Critical View of Safety (CVS) is a clinically mandated criterion for reducing bile duct injury during laparoscopic cholecystectomy; however, its automated recognition from endoscopic video remains challenging due to visual occlusion, depth ambiguity, and the inherently progressive nature of CVS formation across time. This work aims to develop a robust and clinically interpretable framework for automated multi-label CVS recognition from monocular surgical video, without relying on auxiliary segmentation supervision or stereo hardware.

Methods

We propose a novel spatio-temporal CVS recognition framework that integrates depth-augmented visual representations with efficient temporal state-space modeling. The approach employs a DINOv2-based vision foundation model extended to RGB-D input for robust self-supervised spatial representation learning, alongside a Swin Transformer for hierarchical and anatomically localized feature encoding. To capture the temporal persistence and geometric consistency required for CVS identification, a depth-aware Spatio-temporal Mamba module is introduced to model long-range temporal dependencies with linear computational complexity. The network produces multi-label predictions corresponding to individual CVS criteria.

Results

Experimental evaluations demonstrate that the proposed RGB-D spatio-temporal architecture consistently outperforms RGB-only and attention-based temporal baselines. The method shows improved robustness to visual occlusion, viewpoint variation, and dataset shift across evaluation scenarios.

Conclusion

The proposed RGB-D spatio-temporal framework demonstrates that integrating weight-inflated foundation model adaptation, hierarchical spatial encoding, and depth-conditioned selective state-space temporal modeling yields reliable, scalable, and clinically interpretable CVS recognition. In contrast to prior video SSM approaches that process homogeneous RGB token sequences, the depth-aware gating and dual-encoder fusion introduced here provide targeted inductive biases suited to the geometric and temporal demands of surgical safety verification.

Schlagwörter

Stichwörter der Autor:innen

RGB-DSpatio-temporal MambaSwin transformerVisual foundation

Autor:innen und Institutionen

  • Digital Solutions, Intuitive Surgical, 5655 Spalding Drive, Peachtree Corners, GA, 30092, USA. rui.guo@intusurg.com.
  • Digital Solutions, Intuitive Surgical, 5655 Spalding Drive, Peachtree Corners, GA, 30092, USA.

Zitieren

APA

Guo, R., Mueller, B., Zhang, X., & Liu, X. (2026). Enhancing critical view of safety recognition using vision foundation models and state-space temporal modeling. International Journal of Computer Assisted Radiology and Surgery. https://doi.org/10.1007/s11548-026-03748-3

Vancouver

Guo R, Mueller B, Zhang X, Liu X. Enhancing critical view of safety recognition using vision foundation models and state-space temporal modeling. International Journal of Computer Assisted Radiology and Surgery. 2026. doi:10.1007/s11548-026-03748-3

BibTeX
@article{Guo2026,
  author = {Guo, Rui and Mueller, Benjamin and Zhang, Xiaorui and Liu, Xi},
  title = {Enhancing critical view of safety recognition using vision foundation models and state-space temporal modeling},
  journal = {International Journal of Computer Assisted Radiology and Surgery},
  year = {2026},
  doi = {10.1007/s11548-026-03748-3}
}
Kostenlos starten →