EUVIMEDEUVIMED entdecken
Systematische ÜbersichtOpen Access · CC BY 4.0

Evaluation of objective tools and artificial intelligence in robotic surgery technical skills assessment: a systematic review

Matthew W E Boal iD, Dimitrios Anastasiou, Freweini Tesfai, Walaa Ghamrawi, Evangelos Mazomenos, Nathan Curtis iD, Justin W Collins, Ashwin Sridhar, John Kelly, Danail Stoyanov iD, Nader K Francis iD

British Journal of Surgery · 03.01.2024 · 111 (1)

DOI: 10.1093/bjs/znad331 ↗

Kurz gefasst

Systematische Übersicht in der Zeitschrift British Journal of Surgery, online erschienen am 10.11.2023. Verfasst von Matthew W E Boal und 10 weiteren Autor:innen. Beteiligte Einrichtung: The Griffin Institute, Northwick Park & St Marks' Hospital, London, UK. Hauptthemen laut MEDLINE: Robotic Surgical Procedures, Robotics, Laparoscopy. Die Arbeit wurde bisher 105-mal zitiert (Crossref) und nennt 283 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

There is a need to standardize training in robotic surgery, including objective assessment for accreditation. This systematic review aimed to identify objective tools for technical skills assessment, providing evaluation statuses to guide research and inform implementation into training curricula.

Methods

A systematic literature search was conducted in accordance with the PRISMA guidelines. Ovid Embase/Medline, PubMed and Web of Science were searched. Inclusion criterion: robotic surgery technical skills tools. Exclusion criteria: non-technical, laparoscopy or open skills only. Manual tools and automated performance metrics (APMs) were analysed using Messick's concept of validity and the Oxford Centre of Evidence-Based Medicine (OCEBM) Levels of Evidence and Recommendation (LoR). A bespoke tool analysed artificial intelligence (AI) studies. The Modified Downs–Black checklist was used to assess risk of bias.

Results

Two hundred and forty-seven studies were analysed, identifying: 8 global rating scales, 26 procedure-/task-specific tools, 3 main error-based methods, 10 simulators, 28 studies analysing APMs and 53 AI studies. Global Evaluative Assessment of Robotic Skills and the da Vinci Skills Simulator were the most evaluated tools at LoR 1 (OCEBM). Three procedure-specific tools, 3 error-based methods and 1 non-simulator APMs reached LoR 2. AI models estimated outcomes (skill or clinical), demonstrating superior accuracy rates in the laboratory with 60 per cent of methods reporting accuracies over 90 per cent, compared to real surgery ranging from 67 to 100 per cent.

Conclusions

Manual and automated assessment tools for robotic surgery are not well validated and require further evaluation before use in accreditation processes. PROSPERO: registration ID CRD42022304901

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Robotic Surgical ProceduresRoboticsLaparoscopyHumansArtificial IntelligenceClinical Competence

Autor:innen und Institutionen

  • The Griffin Institute, Northwick Park & St Marks' Hospital, London, UK.
  • Wellcome/ESPRC Centre for Interventional Surgical Sciences (WEISS), University College London (UCL), London, UK.
  • Division of Surgery and Interventional Science, Research Department of Targeted Intervention, UCL, London, UK.
  • Medical Physics and Biomedical Engineering, UCL, London, UK.
  • Department of General Surgey, Dorset County Hospital NHS Foundation Trust, Dorchester, UK.
  • University College London Hospitals NHS Foundation Trust, London, UK.

ORCID-Profile: Matthew W E Boal, Nathan Curtis, Danail Stoyanov, Nader K Francis

Zitieren

APA

Boal, M. W. E., Anastasiou, D., Tesfai, F., Ghamrawi, W., Mazomenos, E., Curtis, N., Collins, J. W., Sridhar, A., Kelly, J., Stoyanov, D., & Francis, N. K. (2024). Evaluation of objective tools and artificial intelligence in robotic surgery technical skills assessment: a systematic review. British Journal of Surgery, 111(1). https://doi.org/10.1093/bjs/znad331

Vancouver

Boal MWE, Anastasiou D, Tesfai F, Ghamrawi W, Mazomenos E, Curtis N, et al. Evaluation of objective tools and artificial intelligence in robotic surgery technical skills assessment: a systematic review. British Journal of Surgery. 2024;111(1). doi:10.1093/bjs/znad331

BibTeX
@article{Boal2024,
  author = {Boal, Matthew W E and Anastasiou, Dimitrios and Tesfai, Freweini and Ghamrawi, Walaa and Mazomenos, Evangelos and Curtis, Nathan and Collins, Justin W and Sridhar, Ashwin and Kelly, John and Stoyanov, Danail and Francis, Nader K},
  title = {Evaluation of objective tools and artificial intelligence in robotic surgery technical skills assessment: a systematic review},
  journal = {British Journal of Surgery},
  year = {2024},
  volume = {111},
  number = {1},
  doi = {10.1093/bjs/znad331}
}
Kostenlos starten →