EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

An analysis on the effect of body tissues and surgical tools on workflow recognition in first person surgical videos

Hisako Tomita, Naoto Ienaga, Hiroki Kajita, Tetsu Hayashida, Maki Sugimoto

International Journal of Computer Assisted Radiology and Surgery · 2024

DOI: 10.1007/s11548-024-03074-6 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Computer Assisted Radiology and Surgery, 2024. Verfasst von Hisako Tomita und 4 weiteren Autor:innen. Beteiligte Einrichtung: Graduate School of Science and Technology, Keio University, Yokohama, 2238522, Japan. t-hisako@keio.jp. Hauptthemen laut MEDLINE: Workflow, Video Recording. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 22 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Purpose

Analysis of operative fields is expected to aid in estimating procedural workflow and evaluating surgeons’ procedural skills by considering the temporal transitions during the progression of the surgery. This study aims to propose an automatic recognition system for the procedural workflow by employing machine learning techniques to identify and distinguish elements in the operative field, including body tissues such as fat, muscle, and dermis, along with surgical tools.

Methods

We conducted annotations on approximately 908 first-person-view images of breast surgery to facilitate segmentation. The annotated images were used to train a pixel-level classifier based on Mask R-CNN. To assess the impact on procedural workflow recognition, we annotated an additional 43,007 images. The network, structured on the Transformer architecture, was then trained with surgical images incorporating masks for body tissues and surgical tools.

Results

The instance segmentation of each body tissue in the segmentation phase provided insights into the trend of area transitions for each tissue. Simultaneously, the spatial features of the surgical tools were effectively captured. In regard to the accuracy of procedural workflow recognition, accounting for body tissues led to an average improvement of 3 % over the baseline. Furthermore, the inclusion of surgical tools yielded an additional increase in accuracy by 4 % compared to the baseline.

Conclusion

In this study, we revealed the contribution of the temporal transition of the body tissues and surgical tools spatial features to recognize procedural workflow in first-person-view surgical videos. Body tissues, especially in open surgery, can be a crucial element. This study suggests that further improvements can be achieved by accurately identifying surgical tools specific to each procedural workflow step.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

WorkflowVideo RecordingHumansFemaleSurgical InstrumentsMachine Learning

Stichwörter der Autor:innen

Body tissuesSegmentationSurgical toolsThe first-person-view surgical videoWorkflow recognition

Autor:innen und Institutionen

  • Graduate School of Science and Technology, Keio University, Yokohama, 2238522, Japan. t-hisako@keio.jp.
  • Institute of Systems and Information Engineering, University of Tsukuba, Tsukuba, 3058573, Japan.
  • Department of Plastic and Reconstructive Surgery, Keio University School of Medicine, Tokyo, 1608582, Japan.
  • Department of Surgery, Keio University School of Medicine, Tokyo, 1608582, Japan.
  • Graduate School of Science and Technology, Keio University, Yokohama, 2238522, Japan.

Zitieren

APA

Tomita, H., Ienaga, N., Kajita, H., Hayashida, T., & Sugimoto, M. (2024). An analysis on the effect of body tissues and surgical tools on workflow recognition in first person surgical videos. International Journal of Computer Assisted Radiology and Surgery. https://doi.org/10.1007/s11548-024-03074-6

Vancouver

Tomita H, Ienaga N, Kajita H, Hayashida T, Sugimoto M. An analysis on the effect of body tissues and surgical tools on workflow recognition in first person surgical videos. International Journal of Computer Assisted Radiology and Surgery. 2024. doi:10.1007/s11548-024-03074-6

BibTeX
@article{Tomita2024,
  author = {Tomita, Hisako and Ienaga, Naoto and Kajita, Hiroki and Hayashida, Tetsu and Sugimoto, Maki},
  title = {An analysis on the effect of body tissues and surgical tools on workflow recognition in first person surgical videos},
  journal = {International Journal of Computer Assisted Radiology and Surgery},
  year = {2024},
  doi = {10.1007/s11548-024-03074-6}
}
Kostenlos starten →