Deep learning prediction of error and skill in robotic prostatectomy suturing
Surgical Endoscopy · 2024-12 · 38 (12) · 7663-7671
DOI: 10.1007/s00464-024-11341-5 ↗Kurz gefasst
Fachartikel in der Zeitschrift Surgical Endoscopy, online erschienen am 21.10.2024. Verfasst von N Sirajudeen und 9 weiteren Autor:innen. Beteiligte Einrichtung: Wellcome/ESPRC Centre for Interventional Surgical Sciences (WEISS), University College London (UCL), London, UK. Hauptthemen laut MEDLINE: Prostatectomy, Robotic Surgical Procedures, Deep Learning, Clinical Competence. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Background
Manual objective assessment of skill and errors in minimally invasive surgery have been validated with correlation to surgical expertise and patient outcomes. However, assessment and error annotation can be subjective and are time-consuming processes, often precluding their use. Recent years have seen the development of artificial intelligence models to work towards automating the process to allow reduction of errors and truly objective assessment. This study aimed to validate surgical skill rating and error annotations in suturing gestures to inform the development and evaluation of AI models.
Methods
SAR-RARP50 open data set was blindly, independently annotated at the gesture level in Robotic-Assisted Radical Prostatectomy (RARP) suturing. Manual objective assessment tools and error annotation methodology, Objective Clinical Human Reliability Analysis (OCHRA), were used as ground truth to train and test vision-based deep learning methods to estimate skill and errors. Analysis included descriptive statistics plus tool validity and reliability.
Results
Fifty-four RARP videos (266 min) were analysed. Strong/excellent inter-rater reliability (range r = 0.70–0.89, p < 0.001) and very strong correlation ( r = 0.92, p < 0.001) between objective assessment tools was demonstrated. Skill estimation of OSATS and M-GEARS had a Spearman’s Correlation Coefficient 0.37 and 0.36, respectively, with normalised mean absolute error representing a prediction error of 17.92% (inverted “accuracy” 82.08%) and 20.6% (inverted “accuracy” 79.4%) respectively. The best performing models in error prediction achieved mean absolute precision of 37.14%, area under the curve 65.10% and Macro-F1 58.97%.
Conclusions
This is the first study to employ detailed error detection methodology and deep learning models within real robotic surgical video. This benchmark evaluation of AI models sets a foundation and promising approach for future advancements in automated technical skill assessment. Graphical abstract
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Wellcome/ESPRC Centre for Interventional Surgical Sciences (WEISS), University College London (UCL), London, UK.
- The Griffin Institute, Northwick Park and St Marks Hospital, London, UK.
- Division of Surgery and Interventional Science, Research Department of Targeted Intervention, UCL, London, UK.
- Medical Physics and Biomedical Engineering, UCL, London, UK.
- Computer Vision, UCL, London, UK.
- University College London Hospitals NHS Foundation Trust, London, UK.
ORCID-Profile: N K Francis
Zitieren
APA
Sirajudeen, N., Boal, M., Anastasiou, D., Xu, J., Stoyanov, D., Kelly, J., Collins, J. W., Sridhar, A., Mazomenos, E., & Francis, N. K. (2024). Deep learning prediction of error and skill in robotic prostatectomy suturing. Surgical Endoscopy, 38(12), 7663-7671. https://doi.org/10.1007/s00464-024-11341-5
Vancouver
Sirajudeen N, Boal M, Anastasiou D, Xu J, Stoyanov D, Kelly J, et al. Deep learning prediction of error and skill in robotic prostatectomy suturing. Surgical Endoscopy. 2024;38(12):7663-7671. doi:10.1007/s00464-024-11341-5
BibTeX
@article{Sirajudeen2024,
author = {Sirajudeen, N and Boal, M and Anastasiou, D and Xu, J and Stoyanov, D and Kelly, J and Collins, J W and Sridhar, A and Mazomenos, E and Francis, N K},
title = {Deep learning prediction of error and skill in robotic prostatectomy suturing},
journal = {Surgical Endoscopy},
year = {2024},
volume = {38},
number = {12},
pages = {7663--7671},
doi = {10.1007/s00464-024-11341-5}
}
EUVIMED