EUVIMEDEUVIMED entdecken
Open Access

Clinical AI is not (yet) trustworthy-but it could be (Preprint)

Ali Saad iD, Sofia B Dias iD, Ghada Alhussein iD, David Lyreskog iD, Ioannis Gerasimou iD, Beatriz Alves iD, Μaarten de Vos iD, Ioannis Drivas iD, John Zaras iD, Andreas Stergioulas iD, Iskanter Bensenousi iD, Leontios Hadjileontiadis iD und 2 weitere

Journal of Medical Internet Research · 2025

DOI: 10.2196/85433 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Medical Internet Research, 2025. Verfasst von Ali Saad und 13 weiteren Autor:innen. Beteiligte Einrichtung: AINIGMA Technologies, Leuven, Belgium. Hauptthemen laut MEDLINE: Artificial Intelligence, Trust. Die Arbeit nennt 37 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The growing emphasis on trustworthy artificial intelligence (AI) in health care reflects a shift away from models optimized for predictive performance toward governable and auditable systems that can be adopted and sustained in clinical practice. Nonetheless, many clinical AI applications continue to privilege technical performance while underaddressing ethical, regulatory, and societal considerations, leading to concerns around robustness, transparency, and clinical adoption. To address this, governance frameworks such as the Assessment List for Trustworthy Artificial Intelligence (ALTAI) have been proposed to operationalize trust-related requirements across the AI lifecycle. However, evidence on the practical use of these frameworks remains limited. In this Viewpoint, we describe the application of ALTAI as a procedural governance framework within the Horizon Europe AI-PROGNOSIS project, which aims to support Parkinson disease diagnosis and care through predictive models and digital biomarkers derived from everyday devices. The seven ALTAI requirements (ie, human agency and oversight; technical robustness and safety; privacy and data governance; transparency; diversity, nondiscrimination, and fairness; societal and environmental well-being; and accountability) were mapped to key stages of the AI lifecycle within the project, including design and specification, data preparation, model development and validation, user interface and user experience deployment, external prospective validation, and overarching management and workflow. To examine how these requirements were perceived in practice, we conducted a structured internal survey among AI developers and data scientists involved in the AI-PROGNOSIS project (n=10). Participants rated the relevance of the 17 ALTAI subdomains using a three-point prioritization scale. Technical accuracy, data governance, and privacy were consistently rated as highly relevant, whereas societal impact received the lowest prioritization. This pattern reflects a documented tension in AI development, where technical teams tend to deprioritize broader societal concerns under delivery and performance constraints. Nonetheless, this work should be interpreted as a context-specific case study rather than a validation of ALTAI. The small sample size and project-specific setting limit generalizability, and these findings should not be considered as representative of broader clinical AI development. Overall, by making prioritization gaps explicit and embedding multidisciplinary review across lifecycle checkpoints, this case study illustrates how structured governance frameworks can surface implementation tensions and support accountable AI development. While these approaches do not resolve all of the aforementioned challenges, they provide practical guidance for integrating trust-related considerations into clinical AI projects.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Artificial IntelligenceTrustHumansParkinson Disease

Stichwörter der Autor:innen

AI-PROGNOSIS European research initiativeALTAI Frameworkassessment list for trustworthy artificial intelligenceclinical AIethical AI integrationlifecycle safeguardstrustworthy artificial intelligence (AI)

Autor:innen und Institutionen

  • AINIGMA Technologies, Leuven, Belgium.
  • Faculdade de Motricidade Humana, Universidade de Lisboa, Centro Interdisciplinar de Estudo da Performance Humana, Lisbon, Portugal.
  • Department of Biomedical Engineering and Biotechnology, College of Medicine and Health Sciences, Khalifa University of Science and Technology, Abu Dhabi, United Arab Emirates.
  • NEUROSEC, Department of Psychiatry, University of Oxford, Oxford, United Kingdom.
  • Department of Electrical and Computer Engineering, School of Engineering, Aristotle University of Thessaloniki, Thessaloniki, Greece.
  • Faculdade de Motricidade Humana, University of Lisbon, Lisbon, Portugal.

ORCID-Profile: Ali Saad, Sofia B Dias, Ghada Alhussein, David Lyreskog, Ioannis Gerasimou, Beatriz Alves, Μaarten de Vos, Ioannis Drivas, John Zaras, Andreas Stergioulas, Iskanter Bensenousi, Leontios Hadjileontiadis, Christos Chatzichristos, Stelios Hadjidimitriou

Zitieren

APA

Saad, A., Dias, S. B., Alhussein, G., Lyreskog, D., Gerasimou, I., Alves, B., de Vos, Μ., Drivas, I., Zaras, J., Stergioulas, A., Bensenousi, I., Hadjileontiadis, L., Chatzichristos, C., & Hadjidimitriou, S. (2025). Clinical AI is not (yet) trustworthy-but it could be (Preprint). Journal of Medical Internet Research. https://doi.org/10.2196/85433

Vancouver

Saad A, Dias SB, Alhussein G, Lyreskog D, Gerasimou I, Alves B, et al. Clinical AI is not (yet) trustworthy-but it could be (Preprint). Journal of Medical Internet Research. 2025. doi:10.2196/85433

BibTeX
@article{Saad2025,
  author = {Saad, Ali and Dias, Sofia B and Alhussein, Ghada and Lyreskog, David and Gerasimou, Ioannis and Alves, Beatriz and de Vos, Μaarten and Drivas, Ioannis and Zaras, John and Stergioulas, Andreas and Bensenousi, Iskanter and Hadjileontiadis, Leontios and Chatzichristos, Christos and Hadjidimitriou, Stelios},
  title = {Clinical AI is not (yet) trustworthy-but it could be (Preprint)},
  journal = {Journal of Medical Internet Research},
  year = {2025},
  doi = {10.2196/85433}
}
Kostenlos starten →