Development of an Automated Composite Ureteroscopic Efficiency Score Through Simulated Ureteroscopic Skills Assessment
Journal of Endourology · 2023
DOI: 10.1089/end.2022.0820 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Endourology, 2023. Verfasst von Marie-Therese Valovska und 4 weiteren Autor:innen. Beteiligte Einrichtung: Division of Urology, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA. Hauptthemen laut MEDLINE: Ureteroscopy, Urolithiasis. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 20 Literaturangaben.
Abstract (Originalsprache)
Introduction
Flexible ureteroscopy (fURS) is the most common procedure for treatment of urolithiasis. We previously utilized kinematic evaluations of simulated fURS to demonstrate that certain body movements are associated with efficient ureteroscopic manipulation for complex tasks. In this study, we incorporated computer vision to create an efficiency score using the ureteroscope travel distance (DIST), task time (TIME), spectral arc length (SPARC), and percentage of purposeful wall collisions (COLL). The goal is a simulation-based system that can abstract these automated performance metrics (APMs) to differentiate between novice and expert ureteroscope handling.
Methods
A ureteroscopic simulation box was used. Body kinematics, task time, and ureteroscopic movements were analyzed using a motion capture system and video camera. Optical flow computer vision was used to track the ureteroscope. DIST, TIME, and SPARC were automatically calculated. Wall collisions were automatically captured and independently judged by two authors; an algorithm was developed to automatically determine the COLL variable. A mixed-effects model was used to aggregate these variables and distinguish between surgeons' first and final task attempts. Normalized values of these metrics were added to create a composite ureteroscopic efficiency score (CUES).
Results
Twelve urologists completed the simulated tasks. The COLL assessment algorithm determined beneficial wall collisions with an accuracy of 77%. Normalized values of TIME, DIST, SPARC, and COLL were combined to create a composite ureteroscopic efficiency score (CUES). Compared with the first attempt, both the second and third attempts showed statistically significant improvements in CUES. The ROC-AUC score reached 0.86, suggesting excellent discrimination between attempts. There was also a statistically significant difference in CUES when comparing resident and attending performance.
Conclusions
APMs can be abstracted using computer vision and artificial intelligence; an aggregate composite score (CUES) may be a promising method for evaluation of ureteroscopic efficiency.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Division of Urology, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA.
- School of Industrial Engineering, Purdue University, West Lafayette, Indiana, USA.
Zitieren
APA
Valovska, M. T., Yang, J., Chen, N., Yu, D., & Wollin, D. A. (2023). Development of an Automated Composite Ureteroscopic Efficiency Score Through Simulated Ureteroscopic Skills Assessment. Journal of Endourology. https://doi.org/10.1089/end.2022.0820
Vancouver
Valovska MT, Yang J, Chen N, Yu D, Wollin DA. Development of an Automated Composite Ureteroscopic Efficiency Score Through Simulated Ureteroscopic Skills Assessment. Journal of Endourology. 2023. doi:10.1089/end.2022.0820
BibTeX
@article{Valovska2023,
author = {Valovska, Marie-Therese and Yang, Jing and Chen, Nan and Yu, Denny and Wollin, Daniel A},
title = {Development of an Automated Composite Ureteroscopic Efficiency Score Through Simulated Ureteroscopic Skills Assessment},
journal = {Journal of Endourology},
year = {2023},
doi = {10.1089/end.2022.0820}
}
EUVIMED