EUVIMEDEUVIMED entdecken
Open Access

Trust but Verify: Lessons Learned for the Application of AI to Case-Based Clinical Decision-Making From Postmarketing Drug Safety Assessment at the US Food and Drug Administration

Robert Ball iD, Andrew H Talal iD, Oanh Dang iD, Monica Muñoz iD, Marianthi Markatou iD

Journal of Medical Internet Research · 06.06.2024 · 26 · e50274

DOI: 10.2196/50274 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Medical Internet Research, online erschienen am 06.06.2024. Verfasst von Robert Ball und 4 weiteren Autor:innen. Beteiligte Einrichtung: Office of Surveillance and Epidemiology, Center for Drug Evaluation and Research, US Food and Drug Administration, Silver Spring, MD, United States. Hauptthemen laut MEDLINE: United States Food and Drug Administration, Artificial Intelligence. Die Arbeit wurde bisher 23-mal zitiert (Crossref) und nennt 50 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Adverse drug reactions are a common cause of morbidity in health care. The US Food and Drug Administration (FDA) evaluates individual case safety reports of adverse events (AEs) after submission to the FDA Adverse Event Reporting System as part of its surveillance activities. Over the past decade, the FDA has explored the application of artificial intelligence (AI) to evaluate these reports to improve the efficiency and scientific rigor of the process. However, a gap remains between AI algorithm development and deployment. This viewpoint aims to describe the lessons learned from our experience and research needed to address both general issues in case-based reasoning using AI and specific needs for individual case safety report assessment. Beginning with the recognition that the trustworthiness of the AI algorithm is the main determinant of its acceptance by human experts, we apply the Diffusion of Innovations theory to help explain why certain algorithms for evaluating AEs at the FDA were accepted by safety reviewers and others were not. This analysis reveals that the process by which clinicians decide from case reports whether a drug is likely to cause an AE is not well defined beyond general principles. This makes the development of high performing, transparent, and explainable AI algorithms challenging, leading to a lack of trust by the safety reviewers. Even accounting for the introduction of large language models, the pharmacovigilance community needs an improved understanding of causal inference and of the cognitive framework for determining the causal relationship between a drug and an AE. We describe specific future research directions that underpin facilitating implementation and trust in AI for drug safety applications, including improved methods for measuring and controlling of algorithmic uncertainty, computational reproducibility, and clear articulation of a cognitive framework for causal inference in case-based reasoning.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

United States Food and Drug AdministrationArtificial IntelligenceUnited StatesHumansDrug-Related Side Effects and Adverse ReactionsClinical Decision-MakingProduct Surveillance, PostmarketingAdverse Drug Reaction Reporting SystemsAlgorithmsTrust

Stichwörter der Autor:innen

artificial intelligencecase-based reasoningcausal inferenceclinical decision supportdrug safetymachine learningnatural language processing

Autor:innen und Institutionen

  • Office of Surveillance and Epidemiology, Center for Drug Evaluation and Research, US Food and Drug Administration, Silver Spring, MD, United States.
  • Jacobs School of Medicine and Biomedical Sciences, Buffalo, NY, United States.
  • School of Public Health and Health Professions, University at Buffalo, Buffalo, NY, United States.

ORCID-Profile: Robert Ball, Andrew H Talal, Oanh Dang, Monica Muñoz, Marianthi Markatou

Zitieren

APA

Ball, R., Talal, A. H., Dang, O., Muñoz, M., & Markatou, M. (2024). Trust but Verify: Lessons Learned for the Application of AI to Case-Based Clinical Decision-Making From Postmarketing Drug Safety Assessment at the US Food and Drug Administration. Journal of Medical Internet Research, 26, e50274. https://doi.org/10.2196/50274

Vancouver

Ball R, Talal AH, Dang O, Muñoz M, Markatou M. Trust but Verify: Lessons Learned for the Application of AI to Case-Based Clinical Decision-Making From Postmarketing Drug Safety Assessment at the US Food and Drug Administration. Journal of Medical Internet Research. 2024;26:e50274. doi:10.2196/50274

BibTeX
@article{Ball2024,
  author = {Ball, Robert and Talal, Andrew H and Dang, Oanh and Muñoz, Monica and Markatou, Marianthi},
  title = {Trust but Verify: Lessons Learned for the Application of AI to Case-Based Clinical Decision-Making From Postmarketing Drug Safety Assessment at the US Food and Drug Administration},
  journal = {Journal of Medical Internet Research},
  year = {2024},
  volume = {26},
  pages = {e50274},
  doi = {10.2196/50274}
}
Kostenlos starten →