EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

When Is It Safe to Introduce an AI System Into Healthcare? A Practical Decision Algorithm for the Ethical Implementation of Black‐Box AI in Medicine

Jemima Winifred Allen iD, Dominic Wilkinson iD, Julian Savulescu

Bioethics · 2026-01 · 40 (1) · 61-72

DOI: 10.1111/bioe.70032 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Bioethics, online erschienen am 18.09.2025. Verfasst von Jemima Winifred Allen und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Paediatrics, Faculty of Medicine, Nursing and Health Sciences, Monash University, Clayton, Victoria, Australia. Hauptthemen laut MEDLINE: Algorithms, Informed Consent, Artificial Intelligence, Delivery of Health Care. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 58 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Wellcome Trust, This study/project is supported by the National Research Foundation, Singapore, under its AI Singapore Programme (AISG Award No: AISG3-GV-2023-012). Additional….

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

There is mounting global interest in the revolutionary potential of AI tools. However, its use in healthcare carries certain risks. Some argue that opaque (‘black box’) AI systems in particular undermine patients' informed consent. While interpretable models offer an alternative, this approach may be impossible with generative AI and large language models (LLMs). Thus, we propose that AI tools should be evaluated for clinical use based on their implementation risk, rather than interpretability. We introduce a practical decision algorithm for the clinical implementation of black‐box AI by evaluating its risk of implementation. Applied to the case of an LLM for surgical informed consent, we assess a system's implementation risk by evaluating: (1) technical robustness, (2) implementation feasibility and (3) analysis of harms and benefits. Accordingly, the system is categorised as minimal‐risk (standard use), moderate‐risk (innovative use) or high‐risk (experimental use). Recommendations for implementation are proportional to risk, requiring more oversight for higher‐risk categories. The algorithm also considers the system's cost‐effectiveness and patients' informed consent.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

AlgorithmsInformed ConsentArtificial IntelligenceDelivery of Health CareHumansRisk AssessmentCost-Benefit Analysis

Stichwörter der Autor:innen

artificial intelligenceblack‐box AIclinical practiceinformed consentlarge language modelsrisk assessment

Autor:innen und Institutionen

  • Department of Paediatrics, Faculty of Medicine, Nursing and Health Sciences, Monash University, Clayton, Victoria, Australia.
  • Uehiro Oxford Insitute, University of Oxford, Oxford, UK.
  • Newborn Care, Oxford University Hospitals NHS Foundation Trust, Oxford, UK.
  • Centre for Biomedical Ethics, Yong Loo Lin School of Medicine, National University of Singapore, Singapore.
  • Murdoch Children's Research Institute, Melbourne, Victoria, Australia.

ORCID-Profile: Jemima Winifred Allen, Dominic Wilkinson

Förderung

  • Wellcome Trust
  • This study/project is supported by the National Research Foundation, Singapore, under its AI Singapore Programme (AISG Award No: AISG3-GV-2023-012). Additional…

Zitieren

APA

Allen, J. W., Wilkinson, D., & Savulescu, J. (2026). When Is It Safe to Introduce an AI System Into Healthcare? A Practical Decision Algorithm for the Ethical Implementation of Black‐Box AI in Medicine. Bioethics, 40(1), 61-72. https://doi.org/10.1111/bioe.70032

Vancouver

Allen JW, Wilkinson D, Savulescu J. When Is It Safe to Introduce an AI System Into Healthcare? A Practical Decision Algorithm for the Ethical Implementation of Black‐Box AI in Medicine. Bioethics. 2026;40(1):61-72. doi:10.1111/bioe.70032

BibTeX
@article{Allen2026,
  author = {Allen, Jemima Winifred and Wilkinson, Dominic and Savulescu, Julian},
  title = {When Is It Safe to Introduce an AI System Into Healthcare? A Practical Decision Algorithm for the Ethical Implementation of Black‐Box AI in Medicine},
  journal = {Bioethics},
  year = {2026},
  volume = {40},
  number = {1},
  pages = {61--72},
  doi = {10.1111/bioe.70032}
}
Kostenlos starten →