EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Deep learning prediction of error and skill in robotic prostatectomy suturing

N Sirajudeen, M Boal, D Anastasiou, J Xu, D Stoyanov, J Kelly, J W Collins, A Sridhar, E Mazomenos, N K Francis iD

Surgical Endoscopy · 2024-12 · 38 (12) · 7663-7671

DOI: 10.1007/s00464-024-11341-5 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Surgical Endoscopy, online erschienen am 21.10.2024. Verfasst von N Sirajudeen und 9 weiteren Autor:innen. Beteiligte Einrichtung: Wellcome/ESPRC Centre for Interventional Surgical Sciences (WEISS), University College London (UCL), London, UK. Hauptthemen laut MEDLINE: Prostatectomy, Robotic Surgical Procedures, Deep Learning, Clinical Competence. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Manual objective assessment of skill and errors in minimally invasive surgery have been validated with correlation to surgical expertise and patient outcomes. However, assessment and error annotation can be subjective and are time-consuming processes, often precluding their use. Recent years have seen the development of artificial intelligence models to work towards automating the process to allow reduction of errors and truly objective assessment. This study aimed to validate surgical skill rating and error annotations in suturing gestures to inform the development and evaluation of AI models.

Methods

SAR-RARP50 open data set was blindly, independently annotated at the gesture level in Robotic-Assisted Radical Prostatectomy (RARP) suturing. Manual objective assessment tools and error annotation methodology, Objective Clinical Human Reliability Analysis (OCHRA), were used as ground truth to train and test vision-based deep learning methods to estimate skill and errors. Analysis included descriptive statistics plus tool validity and reliability.

Results

Fifty-four RARP videos (266 min) were analysed. Strong/excellent inter-rater reliability (range r = 0.70–0.89, p < 0.001) and very strong correlation ( r = 0.92, p < 0.001) between objective assessment tools was demonstrated. Skill estimation of OSATS and M-GEARS had a Spearman’s Correlation Coefficient 0.37 and 0.36, respectively, with normalised mean absolute error representing a prediction error of 17.92% (inverted “accuracy” 82.08%) and 20.6% (inverted “accuracy” 79.4%) respectively. The best performing models in error prediction achieved mean absolute precision of 37.14%, area under the curve 65.10% and Macro-F1 58.97%.

Conclusions

This is the first study to employ detailed error detection methodology and deep learning models within real robotic surgical video. This benchmark evaluation of AI models sets a foundation and promising approach for future advancements in automated technical skill assessment. Graphical abstract

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

ProstatectomyRobotic Surgical ProceduresDeep LearningClinical CompetenceSuture TechniquesHumansMaleReproducibility of Results

Stichwörter der Autor:innen

Deep learningErrorsRoboticTechnical skill

Autor:innen und Institutionen

  • Wellcome/ESPRC Centre for Interventional Surgical Sciences (WEISS), University College London (UCL), London, UK.
  • The Griffin Institute, Northwick Park and St Marks Hospital, London, UK.
  • Division of Surgery and Interventional Science, Research Department of Targeted Intervention, UCL, London, UK.
  • Medical Physics and Biomedical Engineering, UCL, London, UK.
  • Computer Vision, UCL, London, UK.
  • University College London Hospitals NHS Foundation Trust, London, UK.

ORCID-Profile: N K Francis

Zitieren

APA

Sirajudeen, N., Boal, M., Anastasiou, D., Xu, J., Stoyanov, D., Kelly, J., Collins, J. W., Sridhar, A., Mazomenos, E., & Francis, N. K. (2024). Deep learning prediction of error and skill in robotic prostatectomy suturing. Surgical Endoscopy, 38(12), 7663-7671. https://doi.org/10.1007/s00464-024-11341-5

Vancouver

Sirajudeen N, Boal M, Anastasiou D, Xu J, Stoyanov D, Kelly J, et al. Deep learning prediction of error and skill in robotic prostatectomy suturing. Surgical Endoscopy. 2024;38(12):7663-7671. doi:10.1007/s00464-024-11341-5

BibTeX
@article{Sirajudeen2024,
  author = {Sirajudeen, N and Boal, M and Anastasiou, D and Xu, J and Stoyanov, D and Kelly, J and Collins, J W and Sridhar, A and Mazomenos, E and Francis, N K},
  title = {Deep learning prediction of error and skill in robotic prostatectomy suturing},
  journal = {Surgical Endoscopy},
  year = {2024},
  volume = {38},
  number = {12},
  pages = {7663--7671},
  doi = {10.1007/s00464-024-11341-5}
}
Kostenlos starten →