Extra-abdominal trocar and instrument detection for enhanced surgical workflow understanding
International Journal of Computer Assisted Radiology and Surgery · 2024
DOI: 10.1007/s11548-024-03220-0 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Computer Assisted Radiology and Surgery, 2024. Verfasst von Franziska Jurosch und 5 weiteren Autor:innen. Beteiligte Einrichtung: Research Group MITI, Klinikum rechts der Isar, TUM School of Medicine and Health, Technical University of Munich, Munich, Germany. franziska.jurosch@…. Hauptthemen laut MEDLINE: Workflow, Laparoscopy, Surgical Instruments. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 18 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Bundesministerium für Bildung und Forschung, Bayerische Staatsministerium für Wirtschaft, Landesentwicklung und Energie.
Abstract (Originalsprache)
Purpose
Video-based intra-abdominal instrument tracking for laparoscopic surgeries is a common research area. However, the tracking can only be done with instruments that are actually visible in the laparoscopic image. By using extra-abdominal cameras to detect trocars and classify their occupancy state, additional information about the instrument location, whether an instrument is still in the abdomen or not, can be obtained. This can enhance laparoscopic workflow understanding and enrich already existing intra-abdominal solutions.
Methods
A data set of four laparoscopic surgeries recorded with two time-synchronized extra-abdominal 2D cameras was generated. The preprocessed and annotated data were used to train a deep learning-based network architecture consisting of a trocar detection, a centroid tracker and a temporal model to provide the occupancy state of all trocars during the surgery.
Results
The trocar detection model achieves an F1 score of $$95.06\pm 0.88\%$$ 95.06 ± 0.88 % . The prediction of the occupancy state yields an F1 score of $$89.29\pm 5.29\%$$ 89.29 ± 5.29 % , providing a first step towards enhanced surgical workflow understanding.
Conclusion
The current method shows promising results for the extra-abdominal tracking of trocars and their occupancy state. Future advancements include the enlargement of the data set and incorporation of intra-abdominal imaging to facilitate accurate assignment of instruments to trocars.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Research Group MITI, Klinikum rechts der Isar, TUM School of Medicine and Health, Technical University of Munich, Munich, Germany. franziska.jurosch@tum.de.
- Research Group MITI, Klinikum rechts der Isar, TUM School of Medicine and Health, Technical University of Munich, Munich, Germany.
- Department of Surgery, Klinikum rechts der Isar, TUM School of Medicine and Health, Technical University of Munich, Munich, Germany.
Förderung
- Bundesministerium für Bildung und Forschung
- Bayerische Staatsministerium für Wirtschaft, Landesentwicklung und Energie
Zitieren
APA
Jurosch, F., Wagner, L., Jell, A., Islertas, E., Wilhelm, D., & Berlet, M. (2024). Extra-abdominal trocar and instrument detection for enhanced surgical workflow understanding. International Journal of Computer Assisted Radiology and Surgery. https://doi.org/10.1007/s11548-024-03220-0
Vancouver
Jurosch F, Wagner L, Jell A, Islertas E, Wilhelm D, Berlet M. Extra-abdominal trocar and instrument detection for enhanced surgical workflow understanding. International Journal of Computer Assisted Radiology and Surgery. 2024. doi:10.1007/s11548-024-03220-0
BibTeX
@article{Jurosch2024,
author = {Jurosch, Franziska and Wagner, Lars and Jell, Alissa and Islertas, Esra and Wilhelm, Dirk and Berlet, Maximilian},
title = {Extra-abdominal trocar and instrument detection for enhanced surgical workflow understanding},
journal = {International Journal of Computer Assisted Radiology and Surgery},
year = {2024},
doi = {10.1007/s11548-024-03220-0}
}
EUVIMED