EUVIMEDObjevte EUVIMED
ÜbersichtsarbeitOpen access

Resilient Artificial Intelligence in Health: Synthesis and Research Agenda Toward Next-Generation Trustworthy Clinical Decision Support

Carlos Sáez iD, Pablo Ferri iD, Juan M García-Gómez iD

Journal of Medical Internet Research · 2024-06-28 · 26 · e50295

DOI: 10.2196/50295 ↗

At a glance

Übersichtsarbeit in Journal of Medical Internet Research, published online on 2024-06-28. Written by Carlos Sáez and 2 co-authors. Institution: Biomedical Data Science Lab, Instituto Universitario de Tecnologías de la Información y Comunicaciones, Universitat Politècnica de València, Valencia…. Major MEDLINE topics: Artificial Intelligence, Decision Support Systems, Clinical. Cited 38 times so far (Crossref); 66 references. The full text is freely available in PubMed Central.

AbstraktSubjectsBibliografické údajeCiteRelated studies

Abstract (original language)

Artificial intelligence (AI)–based clinical decision support systems are gaining momentum by relying on a greater volume and variety of secondary use data. However, the uncertainty, variability, and biases in real-world data environments still pose significant challenges to the development of health AI, its routine clinical use, and its regulatory frameworks. Health AI should be resilient against real-world environments throughout its lifecycle, including the training and prediction phases and maintenance during production, and health AI regulations should evolve accordingly. Data quality issues, variability over time or across sites, information uncertainty, human-computer interaction, and fundamental rights assurance are among the most relevant challenges. If health AI is not designed resiliently with regard to these real-world data effects, potentially biased data-driven medical decisions can risk the safety and fundamental rights of millions of people. In this viewpoint, we review the challenges, requirements, and methods for resilient AI in health and provide a research framework to improve the trustworthiness of next-generation AI-based clinical decision support.

Subjects

MeSH terms (MEDLINE)

Artificial IntelligenceDecision Support Systems, ClinicalHumans

Author keywords

AI ActAI regulationEHDSEuropean Health Data Spaceartificial intelligenceclinical decision supportclinical decision support systemsclinical medicinedata qualityemergency medical dispatchfairnessmachine learningregulationresiliencetrustworthy AI

Authors and institutions

  • Biomedical Data Science Lab, Instituto Universitario de Tecnologías de la Información y Comunicaciones, Universitat Politècnica de València, Valencia, Spain.

ORCID profiles: Carlos Sáez, Pablo Ferri, Juan M García-Gómez

Cite

APA

Sáez, C., Ferri, P., & García-Gómez, J. M. (2024). Resilient Artificial Intelligence in Health: Synthesis and Research Agenda Toward Next-Generation Trustworthy Clinical Decision Support. Journal of Medical Internet Research, 26, e50295. https://doi.org/10.2196/50295

Vancouver

Sáez C, Ferri P, García-Gómez JM. Resilient Artificial Intelligence in Health: Synthesis and Research Agenda Toward Next-Generation Trustworthy Clinical Decision Support. Journal of Medical Internet Research. 2024;26:e50295. doi:10.2196/50295

BibTeX
@article{Sez2024,
  author = {Sáez, Carlos and Ferri, Pablo and García-Gómez, Juan M},
  title = {Resilient Artificial Intelligence in Health: Synthesis and Research Agenda Toward Next-Generation Trustworthy Clinical Decision Support},
  journal = {Journal of Medical Internet Research},
  year = {2024},
  volume = {26},
  pages = {e50295},
  doi = {10.2196/50295}
}
Start for free →