EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A trustworthy AI reality-check: the lack of transparency of artificial intelligence products in healthcare

Jana Fehr, Brian Citro, Rohit Malpani, Christoph Lippert, Vince I Madai

Frontiers in Digital Health · 20.02.2024 · 6

DOI: 10.3389/fdgth.2024.1267290 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Frontiers in Digital Health, online erschienen am 20.02.2024. Verfasst von Jana Fehr und 4 weiteren Autor:innen. Beteiligte Einrichtung: Digital Health & Machine Learning, Hasso Plattner Institute, Potsdam, Germany. Die Arbeit wurde bisher 138-mal zitiert (Crossref) und nennt 64 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Trustworthy medical AI requires transparency about the development and testing of underlying algorithms to identify biases and communicate potential risks of harm. Abundant guidance exists on how to achieve transparency for medical AI products, but it is unclear whether publicly available information adequately informs about their risks. To assess this, we retrieved public documentation on the 14 available CE-certified AI-based radiology products of the II b risk category in the EU from vendor websites, scientific publications, and the European EUDAMED database. Using a self-designed survey, we reported on their development, validation, ethical considerations, and deployment caveats, according to trustworthy AI guidelines. We scored each question with either 0, 0.5, or 1, to rate if the required information was “unavailable”, “partially available,” or “fully available.” The transparency of each product was calculated relative to all 55 questions. Transparency scores ranged from 6.4% to 60.9%, with a median of 29.1%. Major transparency gaps included missing documentation on training data, ethical considerations, and limitations for deployment. Ethical aspects like consent, safety monitoring, and GDPR-compliance were rarely documented. Furthermore, deployment caveats for different demographics and medical settings were scarce. In conclusion, public documentation of authorized medical AI products in Europe lacks sufficient public transparency to inform about safety and risks. We call on lawmakers and regulators to establish legally mandated requirements for public and substantive transparency to fulfill the promise of trustworthy AI for health.

Schlagwörter

Stichwörter der Autor:innen

AI ethicsmedical AImedical device regulationtransparencytrustworthy AI

Autor:innen und Institutionen

  • Digital Health & Machine Learning, Hasso Plattner Institute, Potsdam, Germany.
  • Digital Engineering Faculty, University of Potsdam, Potsdam, Germany.
  • QUEST Center for Responsible Research, Berlin Institute of Health (BIH), Charité Universitätsmedizin Berlin, Berlin, Germany.
  • Independent Researcher, Chicago, IL, United States.
  • Consultant, Paris, France.
  • Hasso Plattner Institute for Digital Health at Mount Sinai, Icahn School of Medicine at Mount Sinai, New York, NY, United States.

Zitieren

APA

Fehr, J., Citro, B., Malpani, R., Lippert, C., & Madai, V. I. (2024). A trustworthy AI reality-check: the lack of transparency of artificial intelligence products in healthcare. Frontiers in Digital Health, 6. https://doi.org/10.3389/fdgth.2024.1267290

Vancouver

Fehr J, Citro B, Malpani R, Lippert C, Madai VI. A trustworthy AI reality-check: the lack of transparency of artificial intelligence products in healthcare. Frontiers in Digital Health. 2024;6. doi:10.3389/fdgth.2024.1267290

BibTeX
@article{Fehr2024,
  author = {Fehr, Jana and Citro, Brian and Malpani, Rohit and Lippert, Christoph and Madai, Vince I},
  title = {A trustworthy AI reality-check: the lack of transparency of artificial intelligence products in healthcare},
  journal = {Frontiers in Digital Health},
  year = {2024},
  volume = {6},
  doi = {10.3389/fdgth.2024.1267290}
}
Kostenlos starten →