Automatic Annotations by Augmented Reality‐Enabled Laparoscopic Surgery
Healthcare Technology Letters · 2025-01 · 12 (1)
DOI: 10.1049/htl2.70031 ↗Kurz gefasst
Fachartikel in der Zeitschrift Healthcare Technology Letters, online erschienen am 19.11.2025. Verfasst von Alexander Winkler und 5 weiteren Autor:innen. Beteiligte Einrichtung: Chair for Computer Aided Medical Procedures and Augmented Reality (CAMP) Technical University of Munich (TUM) Munich Germany. Die Arbeit nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Bundesministerium für Bildung und Forschung.
Abstract (Originalsprache)
Accurate labels of surgical procedures such as image segmentations or interaction labels are paramount for many of today's medical image computing tasks. Creating a dataset with these labels requires a great deal of manual work and relies on the involvement of medical experts, which is very time‐consuming and costly. We propose a pathway for the automatic generation of such labels utilizing the spatial and temporal registration between a patient, the anatomical model, tracked surgical instruments, and the surgeon's view of the patient. These requirements for the automatic generation of labels are identical to the requirements of many navigated and augmented reality (AR) enabled surgeries. The AR system, through 3D registration, has the defining ability to accurately overlay real objects with their virtual counterparts. Our approach collects the complete raw data (e.g. video, tracking data, calibrations etc.) that feeds a live laparoscopic AR system for later analysis. By converting these complete recordings of the surgery into different representations, the AR system generates valuable datasets as mere by‐products. Additionally, as our approach does not rely on visual input alone but on additional 3D information, the system can create labels even if the visual input is occluded or a tool interacts with tissue outside of the view of the laparoscopic camera. In this paper, we present a realization of this concept, then evolve this foundational idea into an interactive system that assists users in annotating surgical data. Finally, we gather and analyse feedback from six participants to evaluate the efficacy and user‐friendliness of our system.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Chair for Computer Aided Medical Procedures and Augmented Reality (CAMP) Technical University of Munich (TUM) Munich Germany.
- Department of General, Visceral, and Transplantation Surgery Hospital of the Ludwig Maximilian University (LMU) Munich Germany.
ORCID-Profile: Alexander Winkler
Förderung
- Bundesministerium für Bildung und Forschung
Zitieren
APA
Winkler, A., Heiliger, C., Heiliger, T., Eck, U., Karcz, K., & Navab, N. (2025). Automatic Annotations by Augmented Reality‐Enabled Laparoscopic Surgery. Healthcare Technology Letters, 12(1). https://doi.org/10.1049/htl2.70031
Vancouver
Winkler A, Heiliger C, Heiliger T, Eck U, Karcz K, Navab N. Automatic Annotations by Augmented Reality‐Enabled Laparoscopic Surgery. Healthcare Technology Letters. 2025;12(1). doi:10.1049/htl2.70031
BibTeX
@article{Winkler2025,
author = {Winkler, Alexander and Heiliger, Christian and Heiliger, Thomas and Eck, Ulrich and Karcz, Konrad and Navab, Nassir},
title = {Automatic Annotations by Augmented Reality‐Enabled Laparoscopic Surgery},
journal = {Healthcare Technology Letters},
year = {2025},
volume = {12},
number = {1},
doi = {10.1049/htl2.70031}
}
EUVIMED