EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Deep hashing for global registration of preoperative CT and video images for laparoscopic liver surgery

Hanyuan Zhang, Sandun Bulathsinhala, Brian R Davidson, Matthew J Clarkson, João Ramalhinho

International Journal of Computer Assisted Radiology and Surgery · 2025

DOI: 10.1007/s11548-025-03418-w ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Computer Assisted Radiology and Surgery, 2025. Verfasst von Hanyuan Zhang und 4 weiteren Autor:innen. Beteiligte Einrichtung: UCL Hawkes Institute, Department of Medical Physics and Biomedical Engineering, UCL, UK. hanyuan.zhang.23@ucl.ac.uk. Hauptthemen laut MEDLINE: Laparoscopy, Tomography, X-Ray Computed, Video Recording, Liver. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 22 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Invention for Innovation Programme, Engineering and Physical Sciences Research Council.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Purpose

Registration of computed tomography (CT) to laparoscopic video images is vital to enable augmented reality (AR), a technology that holds the promise of minimising the risk of complications during laparoscopic liver surgery. Although several solutions have been presented in the literature, they always rely on an accurate initialisation of the registration that is either obtained manually or automatically estimated on very specific views of the liver. These limitations pose a challenge to the clinical translation of AR.

Methods

We propose the use of a content-based image retrieval (CBIR) framework to obtain an automatic robust initialisation to the registration. Instead of directly registering video and CT, we render a dense set of possible views of the liver from CT and extract liver contour features. To reduce feature maps to lower dimension vectors, we use a deep hashing (DH) network that is trained in a triplet scheme. Registration is obtained by matching the intra-operative image hashing encoding to the closest encodings found in the pre-operative renderings.

Results

We validate our method on synthetic and real data from a phantom and real patient data from eight surgeries. Phantom experiments show that registration errors acceptable for an initial registration are obtained if sufficient pre-operative solutions are considered. In seven out of eight patients, the method is able to obtain a clinically relevant alignment.

Conclusion

We present the first work to adapt DH to the CT to video registration problem. Our results indicate that this framework can effectively replace manual initialisations in multiple views, potentially increasing the translation of these techniques.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

LaparoscopyTomography, X-Ray ComputedVideo RecordingLiverHepatectomySurgery, Computer-AssistedHumansPhantoms, ImagingAugmented Reality

Stichwörter der Autor:innen

Augmented RealityDeep HashingImage RegistrationLaparoscopic Liver Surgery

Autor:innen und Institutionen

  • UCL Hawkes Institute, Department of Medical Physics and Biomedical Engineering, UCL, UK. hanyuan.zhang.23@ucl.ac.uk.
  • Division of Surgery and Interventional Science, UCL, UK.
  • UCL Hawkes Institute, Department of Medical Physics and Biomedical Engineering, UCL, UK.

Förderung

  • Invention for Innovation Programme
  • Engineering and Physical Sciences Research Council

Zitieren

APA

Zhang, H., Bulathsinhala, S., Davidson, B. R., Clarkson, M. J., & Ramalhinho, J. (2025). Deep hashing for global registration of preoperative CT and video images for laparoscopic liver surgery. International Journal of Computer Assisted Radiology and Surgery. https://doi.org/10.1007/s11548-025-03418-w

Vancouver

Zhang H, Bulathsinhala S, Davidson BR, Clarkson MJ, Ramalhinho J. Deep hashing for global registration of preoperative CT and video images for laparoscopic liver surgery. International Journal of Computer Assisted Radiology and Surgery. 2025. doi:10.1007/s11548-025-03418-w

BibTeX
@article{Zhang2025,
  author = {Zhang, Hanyuan and Bulathsinhala, Sandun and Davidson, Brian R and Clarkson, Matthew J and Ramalhinho, João},
  title = {Deep hashing for global registration of preoperative CT and video images for laparoscopic liver surgery},
  journal = {International Journal of Computer Assisted Radiology and Surgery},
  year = {2025},
  doi = {10.1007/s11548-025-03418-w}
}
Kostenlos starten →