EUVIMEDOpdag EUVIMED
Systematische ÜbersichtStudienprotokollOpen access

Detecting Algorithmic Errors and Patient Harms for AI-Enabled Medical Devices in Randomized Controlled Trials: Protocol for a Systematic Review

Aditya U Kale iD, Henry David Jeffry Hogg iD, Russell Pearson iD, Ben Glocker iD, Su Golder iD, April Coombe iD, Justin Waring iD, Xiaoxuan Liu iD, David J Moore iD, Alastair K Denniston iD

JMIR Research Protocols · 2024

DOI: 10.2196/51614 ↗

At a glance

Systematische Übersicht in JMIR Research Protocols, 2024. Written by Aditya U Kale and 9 co-authors. Institution: Institute of Inflammation and Ageing, University of Birmingham, Birmingham, United Kingdom. Major MEDLINE topics: Randomized Controlled Trials as Topic, Artificial Intelligence, Algorithms. Cited 5 times so far (Crossref); 38 references. The full text is freely available in PubMed Central. Funded by: National Institute of Health Research (NIHR) Birmingham Biomedical Research Centre.

AbstractSubjectsBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Background

Artificial intelligence (AI) medical devices have the potential to transform existing clinical workflows and ultimately improve patient outcomes. AI medical devices have shown potential for a range of clinical tasks such as diagnostics, prognostics, and therapeutic decision-making such as drug dosing. There is, however, an urgent need to ensure that these technologies remain safe for all populations. Recent literature demonstrates the need for rigorous performance error analysis to identify issues such as algorithmic encoding of spurious correlations (eg, protected characteristics) or specific failure modes that may lead to patient harm. Guidelines for reporting on studies that evaluate AI medical devices require the mention of performance error analysis; however, there is still a lack of understanding around how performance errors should be analyzed in clinical studies, and what harms authors should aim to detect and report.

Objective

This systematic review will assess the frequency and severity of AI errors and adverse events (AEs) in randomized controlled trials (RCTs) investigating AI medical devices as interventions in clinical settings. The review will also explore how performance errors are analyzed including whether the analysis includes the investigation of subgroup-level outcomes.

Methods

This systematic review will identify and select RCTs assessing AI medical devices. Search strategies will be deployed in MEDLINE (Ovid), Embase (Ovid), Cochrane CENTRAL, and clinical trial registries to identify relevant papers. RCTs identified in bibliographic databases will be cross-referenced with clinical trial registries. The primary outcomes of interest are the frequency and severity of AI errors, patient harms, and reported AEs. Quality assessment of RCTs will be based on version 2 of the Cochrane risk-of-bias tool (RoB2). Data analysis will include a comparison of error rates and patient harms between study arms, and a meta-analysis of the rates of patient harm in control versus intervention arms will be conducted if appropriate.

Results

The project was registered on PROSPERO in February 2023. Preliminary searches have been completed and the search strategy has been designed in consultation with an information specialist and methodologist. Title and abstract screening started in September 2023. Full-text screening is ongoing and data collection and analysis began in April 2024.

Conclusions

Evaluations of AI medical devices have shown promising results; however, reporting of studies has been variable. Detection, analysis, and reporting of performance errors and patient harms is vital to robustly assess the safety of AI medical devices in RCTs. Scoping searches have illustrated that the reporting of harms is variable, often with no mention of AEs. The findings of this systematic review will identify the frequency and severity of AI performance errors and patient harms and generate insights into how errors should be analyzed to account for both overall and subgroup performance. Trial Registration PROSPERO CRD42023387747; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=387747 International Registered Report Identifier (IRRID) PRR1-10.2196/51614

Subjects

MeSH terms (MEDLINE)

Randomized Controlled Trials as TopicArtificial IntelligenceAlgorithmsHumansSystematic Reviews as TopicPatient HarmEquipment and SuppliesResearch Design

Author keywords

AIAI health technologyadverse eventsalgorithm erroralgorithmicartificial intelligencemedical devicepatient safetyrandomized controlled trialssafetysystematic review

Authors and institutions

  • Institute of Inflammation and Ageing, University of Birmingham, Birmingham, United Kingdom.
  • University Hospitals Birmingham NHS Foundation Trust, Birmingham, United Kingdom.
  • NIHR Birmingham Biomedical Research Centre, Birmingham, United Kingdom.
  • NIHR Incubator for AI and Digital Health Research, Birmingham, United Kingdom.
  • Population Health Science Institute, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, United Kingdom.
  • Medicines and Healthcare Products Regulatory Agency, London, United Kingdom.

ORCID profiles: Aditya U Kale, Henry David Jeffry Hogg, Russell Pearson, Ben Glocker, Su Golder, April Coombe, Justin Waring, Xiaoxuan Liu, David J Moore, Alastair K Denniston

Funding

  • National Institute of Health Research (NIHR) Birmingham Biomedical Research Centre

Cite

APA

Kale, A. U., Hogg, H. D. J., Pearson, R., Glocker, B., Golder, S., Coombe, A., Waring, J., Liu, X., Moore, D. J., & Denniston, A. K. (2024). Detecting Algorithmic Errors and Patient Harms for AI-Enabled Medical Devices in Randomized Controlled Trials: Protocol for a Systematic Review. JMIR Research Protocols. https://doi.org/10.2196/51614

Vancouver

Kale AU, Hogg HDJ, Pearson R, Glocker B, Golder S, Coombe A, et al. Detecting Algorithmic Errors and Patient Harms for AI-Enabled Medical Devices in Randomized Controlled Trials: Protocol for a Systematic Review. JMIR Research Protocols. 2024. doi:10.2196/51614

BibTeX
@article{Kale2024,
  author = {Kale, Aditya U and Hogg, Henry David Jeffry and Pearson, Russell and Glocker, Ben and Golder, Su and Coombe, April and Waring, Justin and Liu, Xiaoxuan and Moore, David J and Denniston, Alastair K},
  title = {Detecting Algorithmic Errors and Patient Harms for AI-Enabled Medical Devices in Randomized Controlled Trials: Protocol for a Systematic Review},
  journal = {JMIR Research Protocols},
  year = {2024},
  doi = {10.2196/51614}
}
Start for free →