EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

CRAC-DM: class relation-aware categorical diffusion model for surgical scene segmentation

Yihang Zhou, Chi Xu, Zaid Awad, Stamatia Giannarou

International Journal of Computer Assisted Radiology and Surgery · 13.04.2026 · 21 (5) · 949-958

DOI: 10.1007/s11548-026-03601-7 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Computer Assisted Radiology and Surgery, online erschienen am 13.04.2026. Verfasst von Yihang Zhou und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Surgery and Cancer, Hamlyn Centre for Robotic Surgery, Imperial College London, London, UK. yihang.zhou23@imperial.ac.uk. Hauptthemen laut MEDLINE: Surgery, Computer-Assisted, Image Processing, Computer-Assisted. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 20 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Royal Society.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Purpose

Accurate multi-class segmentation of surgical scenes remains challenging due to ambiguous anatomical boundaries and imaging artifacts. While diffusion-based segmentation methods have achieved good results, they rely on computationally heavy continuous diffusion processes. Recent discrete diffusion variants reduce computation but their performance is limited due to uniform noise, ignoring inter-class relationships that are crucial for generating semantically relevant training signals. To address this gap, we propose the class relation-aware categorical diffusion model (CRAC-DM).

Methods

CRAC-DM consists of three key components. In the forward process, we embed semantic class relationships for the first time when adding categorical noise via a class relation-aware transition matrix, biasing noise toward semantically similar categories to generate class-aware supervision signals. In the reverse process, we introduce a step-skipping categorical denoiser (S2D) tailored for discrete diffusion segmentation, enabling fast inference. To further boost inference, we propose a novel confidence-adaptive test time augmentation (TTA) that selectively refines regions of interest with low prediction confidence using entropy-weighted aggregation.

Results

The proposed CRAC-DM was evaluated on the publicly available CholecSeg8k and EndoVis18 datasets. It consistently outperformed state-of-the-art U-Net-, transformer-, and diffusion-based baselines, particularly on tissue segmentation, even for small and under-represented classes while significantly reducing inference time compared to diffusion baselines.

Conclusion

By enhancing the forward process with inter-class similarity and improving the reverse process with a deterministic S2D and targeted TTA, CRAC-DM achieves superior segmentation accuracy, efficiency, and reliability, paving the way for practical deployment in computer-assisted surgery.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Surgery, Computer-AssistedImage Processing, Computer-AssistedHumansAlgorithms

Stichwörter der Autor:innen

Categorical noiseClass relation modelingDiffusion modelSurgical scene segmentation

Autor:innen und Institutionen

  • Department of Surgery and Cancer, Hamlyn Centre for Robotic Surgery, Imperial College London, London, UK. yihang.zhou23@imperial.ac.uk.
  • Department of Surgery and Cancer, Hamlyn Centre for Robotic Surgery, Imperial College London, London, UK.
  • Imperial College Healthcare NHS Trust, London, UK.

Förderung

  • Royal Society

Zitieren

APA

Zhou, Y., Xu, C., Awad, Z., & Giannarou, S. (2026). CRAC-DM: class relation-aware categorical diffusion model for surgical scene segmentation. International Journal of Computer Assisted Radiology and Surgery, 21(5), 949-958. https://doi.org/10.1007/s11548-026-03601-7

Vancouver

Zhou Y, Xu C, Awad Z, Giannarou S. CRAC-DM: class relation-aware categorical diffusion model for surgical scene segmentation. International Journal of Computer Assisted Radiology and Surgery. 2026;21(5):949-958. doi:10.1007/s11548-026-03601-7

BibTeX
@article{Zhou2026,
  author = {Zhou, Yihang and Xu, Chi and Awad, Zaid and Giannarou, Stamatia},
  title = {CRAC-DM: class relation-aware categorical diffusion model for surgical scene segmentation},
  journal = {International Journal of Computer Assisted Radiology and Surgery},
  year = {2026},
  volume = {21},
  number = {5},
  pages = {949--958},
  doi = {10.1007/s11548-026-03601-7}
}
Kostenlos starten →