Depth over RGB: automatic evaluation of open surgery skills using depth camera
International Journal of Computer Assisted Radiology and Surgery · 15.05.2024 · 19 (7) · 1349-1357
DOI: 10.1007/s11548-024-03158-3 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Computer Assisted Radiology and Surgery, online erschienen am 15.05.2024. Verfasst von Ido Zuckerman und 6 weiteren Autor:innen. Beteiligte Einrichtung: Faculty of Data and Decision Sciences, Technion - Israel Institute of Technology, Haifa, 3200003, Israel. ido.z@campus.technion.ac.il. Hauptthemen laut MEDLINE: Clinical Competence, Video Recording. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 29 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Technion - Israel Institute of Technology.
Abstract (Originalsprache)
Purpose
In this paper, we present a novel approach to the automatic evaluation of open surgery skills using depth cameras. This work is intended to show that depth cameras achieve similar results to RGB cameras, which is the common method in the automatic evaluation of open surgery skills. Moreover, depth cameras offer advantages such as robustness to lighting variations, camera positioning, simplified data compression, and enhanced privacy, making them a promising alternative to RGB cameras.
Methods
Experts and novice surgeons completed two simulators of open suturing. We focused on hand and tool detection and action segmentation in suturing procedures. YOLOv8 was used for tool detection in RGB and depth videos. Furthermore, UVAST and MSTCN++ were used for action segmentation. Our study includes the collection and annotation of a dataset recorded with Azure Kinect.
Results
We demonstrated that using depth cameras in object detection and action segmentation achieves comparable results to RGB cameras. Furthermore, we analyzed 3D hand path length, revealing significant differences between experts and novice surgeons, emphasizing the potential of depth cameras in capturing surgical skills. We also investigated the influence of camera angles on measurement accuracy, highlighting the advantages of 3D cameras in providing a more accurate representation of hand movements.
Conclusion
Our research contributes to advancing the field of surgical skill assessment by leveraging depth cameras for more reliable and privacy evaluations. The findings suggest that depth cameras can be valuable in assessing surgical skills and provide a foundation for future research in this area.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Faculty of Data and Decision Sciences, Technion - Israel Institute of Technology, Haifa, 3200003, Israel. ido.z@campus.technion.ac.il.
- Department of Surgery, University of Wisconsin-Madison School of Medicine and Public Health, 600 Highland Ave, Madison, WI, 53792, USA.
- Faculty of Data and Decision Sciences, Technion - Israel Institute of Technology, Haifa, 3200003, Israel.
- Clinical Simulation Program, University of Wisconsin Hospitals and Clinics, 600 Highland Ave, Madison, WI, 53792, USA.
ORCID-Profile: Ido Zuckerman
Förderung
- Technion - Israel Institute of Technology
Zitieren
APA
Zuckerman, I., Werner, N., Kouchly, J., Huston, E., DiMarco, S., DiMusto, P., & Laufer, S. (2024). Depth over RGB: automatic evaluation of open surgery skills using depth camera. International Journal of Computer Assisted Radiology and Surgery, 19(7), 1349-1357. https://doi.org/10.1007/s11548-024-03158-3
Vancouver
Zuckerman I, Werner N, Kouchly J, Huston E, DiMarco S, DiMusto P, et al. Depth over RGB: automatic evaluation of open surgery skills using depth camera. International Journal of Computer Assisted Radiology and Surgery. 2024;19(7):1349-1357. doi:10.1007/s11548-024-03158-3
BibTeX
@article{Zuckerman2024,
author = {Zuckerman, Ido and Werner, Nicole and Kouchly, Jonathan and Huston, Emma and DiMarco, Shannon and DiMusto, Paul and Laufer, Shlomi},
title = {Depth over RGB: automatic evaluation of open surgery skills using depth camera},
journal = {International Journal of Computer Assisted Radiology and Surgery},
year = {2024},
volume = {19},
number = {7},
pages = {1349--1357},
doi = {10.1007/s11548-024-03158-3}
}
EUVIMED