EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

The Epistemic Cost of Opacity: How the Use of Artificial Intelligence Undermines the Knowledge of Medical Doctors in High-Stakes Contexts

Eva Schmidt, Paul Martin Putora, Rianne Fijten

Philosophy & Technology · 2025-03 · 38 (1)

DOI: 10.1007/s13347-024-00834-9 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Philosophy & Technology, online erschienen am 13.01.2025. Verfasst von Eva Schmidt und 2 weiteren Autor:innen. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 82 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Technische Universität Dortmund.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Artificial intelligent (AI) systems used in medicine are often very reliable and accurate, but at the price of their being increasingly opaque. This raises the question whether a system’s opacity undermines the ability of medical doctors to acquire knowledge on the basis of its outputs. We investigate this question by focusing on a case in which a patient’s risk of recurring breast cancer is predicted by an opaque AI system. We argue that, given the system’s opacity, as well as the possibility of malfunctioning AI systems, practitioners’ inability to check the correctness of their outputs, and the high stakes of such cases, the knowledge of medical practitioners is indeed undermined. They are lucky to form true beliefs based on the AI systems’ outputs, and knowledge is incompatible with luck. We supplement this claim with a specific version of the safety condition on knowledge, Safety*. We argue that, relative to the perspective of the medical doctor in our example case, his relevant beliefs could easily be false, and this despite his evidence that the AI system functions reliably. Assuming that Safety* is necessary for knowledge, the practitioner therefore doesn’t know. We address three objections to our proposal before turning to practical suggestions for improving the epistemic situation of medical doctors.

Förderung

  • Technische Universität Dortmund

Zitieren

APA

Schmidt, E., Putora, P. M., & Fijten, R. (2025). The Epistemic Cost of Opacity: How the Use of Artificial Intelligence Undermines the Knowledge of Medical Doctors in High-Stakes Contexts. Philosophy & Technology, 38(1). https://doi.org/10.1007/s13347-024-00834-9

Vancouver

Schmidt E, Putora PM, Fijten R. The Epistemic Cost of Opacity: How the Use of Artificial Intelligence Undermines the Knowledge of Medical Doctors in High-Stakes Contexts. Philosophy & Technology. 2025;38(1). doi:10.1007/s13347-024-00834-9

BibTeX
@article{Schmidt2025,
  author = {Schmidt, Eva and Putora, Paul Martin and Fijten, Rianne},
  title = {The Epistemic Cost of Opacity: How the Use of Artificial Intelligence Undermines the Knowledge of Medical Doctors in High-Stakes Contexts},
  journal = {Philosophy & Technology},
  year = {2025},
  volume = {38},
  number = {1},
  doi = {10.1007/s13347-024-00834-9}
}
Kostenlos starten →