When Is It Safe to Introduce an AI System Into Healthcare? A Practical Decision Algorithm for the Ethical Implementation of Black‐Box AI in Medicine
Bioethics · 2026-01 · 40 (1) · 61-72
DOI: 10.1111/bioe.70032 ↗Kurz gefasst
Fachartikel in der Zeitschrift Bioethics, online erschienen am 18.09.2025. Verfasst von Jemima Winifred Allen und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Paediatrics, Faculty of Medicine, Nursing and Health Sciences, Monash University, Clayton, Victoria, Australia. Hauptthemen laut MEDLINE: Algorithms, Informed Consent, Artificial Intelligence, Delivery of Health Care. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 58 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Wellcome Trust, This study/project is supported by the National Research Foundation, Singapore, under its AI Singapore Programme (AISG Award No: AISG3-GV-2023-012). Additional….
Abstract (Originalsprache)
There is mounting global interest in the revolutionary potential of AI tools. However, its use in healthcare carries certain risks. Some argue that opaque (‘black box’) AI systems in particular undermine patients' informed consent. While interpretable models offer an alternative, this approach may be impossible with generative AI and large language models (LLMs). Thus, we propose that AI tools should be evaluated for clinical use based on their implementation risk, rather than interpretability. We introduce a practical decision algorithm for the clinical implementation of black‐box AI by evaluating its risk of implementation. Applied to the case of an LLM for surgical informed consent, we assess a system's implementation risk by evaluating: (1) technical robustness, (2) implementation feasibility and (3) analysis of harms and benefits. Accordingly, the system is categorised as minimal‐risk (standard use), moderate‐risk (innovative use) or high‐risk (experimental use). Recommendations for implementation are proportional to risk, requiring more oversight for higher‐risk categories. The algorithm also considers the system's cost‐effectiveness and patients' informed consent.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Paediatrics, Faculty of Medicine, Nursing and Health Sciences, Monash University, Clayton, Victoria, Australia.
- Uehiro Oxford Insitute, University of Oxford, Oxford, UK.
- Newborn Care, Oxford University Hospitals NHS Foundation Trust, Oxford, UK.
- Centre for Biomedical Ethics, Yong Loo Lin School of Medicine, National University of Singapore, Singapore.
- Murdoch Children's Research Institute, Melbourne, Victoria, Australia.
ORCID-Profile: Jemima Winifred Allen, Dominic Wilkinson
Förderung
- Wellcome Trust
- This study/project is supported by the National Research Foundation, Singapore, under its AI Singapore Programme (AISG Award No: AISG3-GV-2023-012). Additional…
Zitieren
APA
Allen, J. W., Wilkinson, D., & Savulescu, J. (2026). When Is It Safe to Introduce an AI System Into Healthcare? A Practical Decision Algorithm for the Ethical Implementation of Black‐Box AI in Medicine. Bioethics, 40(1), 61-72. https://doi.org/10.1111/bioe.70032
Vancouver
Allen JW, Wilkinson D, Savulescu J. When Is It Safe to Introduce an AI System Into Healthcare? A Practical Decision Algorithm for the Ethical Implementation of Black‐Box AI in Medicine. Bioethics. 2026;40(1):61-72. doi:10.1111/bioe.70032
BibTeX
@article{Allen2026,
author = {Allen, Jemima Winifred and Wilkinson, Dominic and Savulescu, Julian},
title = {When Is It Safe to Introduce an AI System Into Healthcare? A Practical Decision Algorithm for the Ethical Implementation of Black‐Box AI in Medicine},
journal = {Bioethics},
year = {2026},
volume = {40},
number = {1},
pages = {61--72},
doi = {10.1111/bioe.70032}
}
EUVIMED