AI as a Medical Device Adverse Event Reporting in Regulatory Databases: Protocol for a Systematic Review
JMIR Research Protocols · 2024-07-11 · 13 · e48156
DOI: 10.2196/48156 ↗At a glance
Systematische Übersicht in JMIR Research Protocols, published online on 2024-07-11. Written by Aditya U Kale and 10 co-authors. Institution: Institute of Inflammation and Ageing, College of Medical and Dental Sciences, University of Birmingham, Birmingham, United Kingdom. Major MEDLINE topics: Artificial Intelligence, Systematic Reviews as Topic. Cited 10 times so far (Crossref); 31 references. The full text is freely available in PubMed Central. Funded by: Department of Health and Social Care.
Abstract (original language)
Background
The reporting of adverse events (AEs) relating to medical devices is a long-standing area of concern, with suboptimal reporting due to a range of factors including a failure to recognize the association of AEs with medical devices, lack of knowledge of how to report AEs, and a general culture of nonreporting. The introduction of artificial intelligence as a medical device (AIaMD) requires a robust safety monitoring environment that recognizes both generic risks of a medical device and some of the increasingly recognized risks of AIaMD (such as algorithmic bias). There is an urgent need to understand the limitations of current AE reporting systems and explore potential mechanisms for how AEs could be detected, attributed, and reported with a view to improving the early detection of safety signals.
Objective
The systematic review outlined in this protocol aims to yield insights into the frequency and severity of AEs while characterizing the events using existing regulatory guidance.
Methods
Publicly accessible AE databases will be searched to identify AE reports for AIaMD. Scoping searches have identified 3 regulatory territories for which public access to AE reports is provided: the United States, the United Kingdom, and Australia. AEs will be included for analysis if an artificial intelligence (AI) medical device is involved. Software as a medical device without AI is not within the scope of this review. Data extraction will be conducted using a data extraction tool designed for this review and will be done independently by AUK and a second reviewer. Descriptive analysis will be conducted to identify the types of AEs being reported, and their frequency, for different types of AIaMD. AEs will be analyzed and characterized according to existing regulatory guidance.
Results
Scoping searches are being conducted with screening to begin in April 2024. Data extraction and synthesis will commence in May 2024, with planned completion by August 2024. The review will highlight the types of AEs being reported for different types of AI medical devices and where the gaps are. It is anticipated that there will be particularly low rates of reporting for indirect harms associated with AIaMD.
Conclusions
To our knowledge, this will be the first systematic review of 3 different regulatory sources reporting AEs associated with AIaMD. The review will focus on real-world evidence, which brings certain limitations, compounded by the opacity of regulatory databases generally. The review will outline the characteristics and frequency of AEs reported for AIaMD and help regulators and policy makers to continue developing robust safety monitoring processes. International Registered Report Identifier (IRRID) PRR1-10.2196/48156
Subjects
MeSH terms (MEDLINE)
Author keywords
Authors and institutions
- Institute of Inflammation and Ageing, College of Medical and Dental Sciences, University of Birmingham, Birmingham, United Kingdom.
- University Hospitals Birmingham NHS Foundation Trust, Birmingham, United Kingdom.
- NIHR Birmingham Biomedical Research Centre, Birmingham, United Kingdom.
- NIHR Incubator for AI and Digital Health Research, Birmingham, United Kingdom.
- Springer Nature Group, London, United Kingdom.
- School of Chemistry, Food and Pharmacy, University of Reading, Reading, United Kingdom.
ORCID profiles: Aditya U Kale, Riya Dattani, Ashley Tabansi, Henry David Jeffry Hogg, Russell Pearson, Ben Glocker, Su Golder, Justin Waring, Xiaoxuan Liu, David J Moore, Alastair K Denniston
Funding
- Department of Health and Social Care
Cite
APA
Kale, A. U., Dattani, R., Tabansi, A., Hogg, H. D. J., Pearson, R., Glocker, B., Golder, S., Waring, J., Liu, X., Moore, D. J., & Denniston, A. K. (2024). AI as a Medical Device Adverse Event Reporting in Regulatory Databases: Protocol for a Systematic Review. JMIR Research Protocols, 13, e48156. https://doi.org/10.2196/48156
Vancouver
Kale AU, Dattani R, Tabansi A, Hogg HDJ, Pearson R, Glocker B, et al. AI as a Medical Device Adverse Event Reporting in Regulatory Databases: Protocol for a Systematic Review. JMIR Research Protocols. 2024;13:e48156. doi:10.2196/48156
BibTeX
@article{Kale2024,
author = {Kale, Aditya U and Dattani, Riya and Tabansi, Ashley and Hogg, Henry David Jeffry and Pearson, Russell and Glocker, Ben and Golder, Su and Waring, Justin and Liu, Xiaoxuan and Moore, David J and Denniston, Alastair K},
title = {AI as a Medical Device Adverse Event Reporting in Regulatory Databases: Protocol for a Systematic Review},
journal = {JMIR Research Protocols},
year = {2024},
volume = {13},
pages = {e48156},
doi = {10.2196/48156}
}
EUVIMED