EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Extra-abdominal trocar and instrument detection for enhanced surgical workflow understanding

Franziska Jurosch, Lars Wagner, Alissa Jell, Esra Islertas, Dirk Wilhelm, Maximilian Berlet

International Journal of Computer Assisted Radiology and Surgery · 2024

DOI: 10.1007/s11548-024-03220-0 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Computer Assisted Radiology and Surgery, 2024. Verfasst von Franziska Jurosch und 5 weiteren Autor:innen. Beteiligte Einrichtung: Research Group MITI, Klinikum rechts der Isar, TUM School of Medicine and Health, Technical University of Munich, Munich, Germany. franziska.jurosch@…. Hauptthemen laut MEDLINE: Workflow, Laparoscopy, Surgical Instruments. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 18 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Bundesministerium für Bildung und Forschung, Bayerische Staatsministerium für Wirtschaft, Landesentwicklung und Energie.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Purpose

Video-based intra-abdominal instrument tracking for laparoscopic surgeries is a common research area. However, the tracking can only be done with instruments that are actually visible in the laparoscopic image. By using extra-abdominal cameras to detect trocars and classify their occupancy state, additional information about the instrument location, whether an instrument is still in the abdomen or not, can be obtained. This can enhance laparoscopic workflow understanding and enrich already existing intra-abdominal solutions.

Methods

A data set of four laparoscopic surgeries recorded with two time-synchronized extra-abdominal 2D cameras was generated. The preprocessed and annotated data were used to train a deep learning-based network architecture consisting of a trocar detection, a centroid tracker and a temporal model to provide the occupancy state of all trocars during the surgery.

Results

The trocar detection model achieves an F1 score of $$95.06\pm 0.88\%$$ 95.06 ± 0.88 % . The prediction of the occupancy state yields an F1 score of $$89.29\pm 5.29\%$$ 89.29 ± 5.29 % , providing a first step towards enhanced surgical workflow understanding.

Conclusion

The current method shows promising results for the extra-abdominal tracking of trocars and their occupancy state. Future advancements include the enlargement of the data set and incorporation of intra-abdominal imaging to facilitate accurate assignment of instruments to trocars.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

WorkflowLaparoscopySurgical InstrumentsHumansVideo RecordingDeep Learning

Stichwörter der Autor:innen

Deep learningSurgical context awarenessSurgical workflow analysisTrocar detection

Autor:innen und Institutionen

  • Research Group MITI, Klinikum rechts der Isar, TUM School of Medicine and Health, Technical University of Munich, Munich, Germany. franziska.jurosch@tum.de.
  • Research Group MITI, Klinikum rechts der Isar, TUM School of Medicine and Health, Technical University of Munich, Munich, Germany.
  • Department of Surgery, Klinikum rechts der Isar, TUM School of Medicine and Health, Technical University of Munich, Munich, Germany.

Förderung

  • Bundesministerium für Bildung und Forschung
  • Bayerische Staatsministerium für Wirtschaft, Landesentwicklung und Energie

Zitieren

APA

Jurosch, F., Wagner, L., Jell, A., Islertas, E., Wilhelm, D., & Berlet, M. (2024). Extra-abdominal trocar and instrument detection for enhanced surgical workflow understanding. International Journal of Computer Assisted Radiology and Surgery. https://doi.org/10.1007/s11548-024-03220-0

Vancouver

Jurosch F, Wagner L, Jell A, Islertas E, Wilhelm D, Berlet M. Extra-abdominal trocar and instrument detection for enhanced surgical workflow understanding. International Journal of Computer Assisted Radiology and Surgery. 2024. doi:10.1007/s11548-024-03220-0

BibTeX
@article{Jurosch2024,
  author = {Jurosch, Franziska and Wagner, Lars and Jell, Alissa and Islertas, Esra and Wilhelm, Dirk and Berlet, Maximilian},
  title = {Extra-abdominal trocar and instrument detection for enhanced surgical workflow understanding},
  journal = {International Journal of Computer Assisted Radiology and Surgery},
  year = {2024},
  doi = {10.1007/s11548-024-03220-0}
}
Kostenlos starten →