Resilient Artificial Intelligence in Health: Synthesis and Research Agenda Toward Next-Generation Trustworthy Clinical Decision Support
Journal of Medical Internet Research · 2024-06-28 · 26 · e50295
DOI: 10.2196/50295 ↗At a glance
Übersichtsarbeit in Journal of Medical Internet Research, published online on 2024-06-28. Written by Carlos Sáez and 2 co-authors. Institution: Biomedical Data Science Lab, Instituto Universitario de Tecnologías de la Información y Comunicaciones, Universitat Politècnica de València, Valencia…. Major MEDLINE topics: Artificial Intelligence, Decision Support Systems, Clinical. Cited 38 times so far (Crossref); 66 references. The full text is freely available in PubMed Central.
Abstract (original language)
Artificial intelligence (AI)–based clinical decision support systems are gaining momentum by relying on a greater volume and variety of secondary use data. However, the uncertainty, variability, and biases in real-world data environments still pose significant challenges to the development of health AI, its routine clinical use, and its regulatory frameworks. Health AI should be resilient against real-world environments throughout its lifecycle, including the training and prediction phases and maintenance during production, and health AI regulations should evolve accordingly. Data quality issues, variability over time or across sites, information uncertainty, human-computer interaction, and fundamental rights assurance are among the most relevant challenges. If health AI is not designed resiliently with regard to these real-world data effects, potentially biased data-driven medical decisions can risk the safety and fundamental rights of millions of people. In this viewpoint, we review the challenges, requirements, and methods for resilient AI in health and provide a research framework to improve the trustworthiness of next-generation AI-based clinical decision support.
Subjects
MeSH terms (MEDLINE)
Author keywords
Authors and institutions
- Biomedical Data Science Lab, Instituto Universitario de Tecnologías de la Información y Comunicaciones, Universitat Politècnica de València, Valencia, Spain.
ORCID profiles: Carlos Sáez, Pablo Ferri, Juan M García-Gómez
Cite
APA
Sáez, C., Ferri, P., & García-Gómez, J. M. (2024). Resilient Artificial Intelligence in Health: Synthesis and Research Agenda Toward Next-Generation Trustworthy Clinical Decision Support. Journal of Medical Internet Research, 26, e50295. https://doi.org/10.2196/50295
Vancouver
Sáez C, Ferri P, García-Gómez JM. Resilient Artificial Intelligence in Health: Synthesis and Research Agenda Toward Next-Generation Trustworthy Clinical Decision Support. Journal of Medical Internet Research. 2024;26:e50295. doi:10.2196/50295
BibTeX
@article{Sez2024,
author = {Sáez, Carlos and Ferri, Pablo and García-Gómez, Juan M},
title = {Resilient Artificial Intelligence in Health: Synthesis and Research Agenda Toward Next-Generation Trustworthy Clinical Decision Support},
journal = {Journal of Medical Internet Research},
year = {2024},
volume = {26},
pages = {e50295},
doi = {10.2196/50295}
}
EUVIMED