EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

AI as an intervention: improving clinical outcomes relies on a causal approach to AI development and validation

Shalmali Joshi, Iñigo Urteaga, Wouter A C van Amsterdam, George Hripcsak, Pierre Elias iD, Benjamin Recht, Noémie Elhadad, James Fackler, Mark P Sendak iD, Jenna Wiens, Kaivalya Deshpande, Yoav Wald und 8 weitere

Journal of the American Medical Informatics Association · 01.03.2025 · 32 (3) · 589-594

DOI: 10.1093/jamia/ocae301 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of the American Medical Informatics Association, online erschienen am 07.01.2025. Verfasst von Shalmali Joshi und 19 weiteren Autor:innen. Beteiligte Einrichtung: Department of Biomedical Informatics, Columbia University, New York, NY 10032, United States. Hauptthemen laut MEDLINE: Artificial Intelligence, Outcome Assessment, Health Care. Die Arbeit wurde bisher 37-mal zitiert (Crossref) und nennt 51 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Machine Learning for Healthcare.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The primary practice of healthcare artificial intelligence (AI) starts with model development, often using state-of-the-art AI, retrospectively evaluated using metrics lifted from the AI literature like AUROC and DICE score. However, good performance on these metrics may not translate to improved clinical outcomes. Instead, we argue for a better development pipeline constructed by working backward from the end goal of positively impacting clinically relevant outcomes using AI, leading to considerations of causality in model development and validation, and subsequently a better development pipeline. Healthcare AI should be “actionable,” and the change in actions induced by AI should improve outcomes. Quantifying the effect of changes in actions on outcomes is causal inference. The development, evaluation, and validation of healthcare AI should therefore account for the causal effect of intervening with the AI on clinically relevant outcomes. Using a causal lens, we make recommendations for key stakeholders at various stages of the healthcare AI pipeline. Our recommendations aim to increase the positive impact of AI on clinical outcomes.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Artificial IntelligenceOutcome Assessment, Health CareHumans

Stichwörter der Autor:innen

artificial intelligencecausal inferencehealthcare

Autor:innen und Institutionen

  • Department of Biomedical Informatics, Columbia University, New York, NY 10032, United States.
  • BCAM-Basque Center for Applied Mathematics, Bilbao 48009, Spain.
  • IKERBASQUE-Basque Foundation for Science, Bilbao 48009, Spain.
  • Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht 3584 CX, The Netherlands.
  • Division of Cardiology, Columbia University, New York, NY 10032, United States.
  • Department of Electrical Engineering and Computer Sciences, University of California, Berkeley, Berkeley, CA 94720, United States.

ORCID-Profile: Pierre Elias, Mark P Sendak

Förderung

  • Machine Learning for Healthcare

Zitieren

APA

Joshi, S., Urteaga, I., van Amsterdam, W. A. C., Hripcsak, G., Elias, P., Recht, B., Elhadad, N., Fackler, J., Sendak, M. P., Wiens, J., Deshpande, K., Wald, Y., Fiterau, M., Lipton, Z., Malinsky, D., Nayan, M., Namkoong, H., Park, S., Vogt, J. E., & Ranganath, R. (2025). AI as an intervention: improving clinical outcomes relies on a causal approach to AI development and validation. Journal of the American Medical Informatics Association, 32(3), 589-594. https://doi.org/10.1093/jamia/ocae301

Vancouver

Joshi S, Urteaga I, van Amsterdam WAC, Hripcsak G, Elias P, Recht B, et al. AI as an intervention: improving clinical outcomes relies on a causal approach to AI development and validation. Journal of the American Medical Informatics Association. 2025;32(3):589-594. doi:10.1093/jamia/ocae301

BibTeX
@article{Joshi2025,
  author = {Joshi, Shalmali and Urteaga, Iñigo and van Amsterdam, Wouter A C and Hripcsak, George and Elias, Pierre and Recht, Benjamin and Elhadad, Noémie and Fackler, James and Sendak, Mark P and Wiens, Jenna and Deshpande, Kaivalya and Wald, Yoav and Fiterau, Madalina and Lipton, Zachary and Malinsky, Daniel and Nayan, Madhur and Namkoong, Hongseok and Park, Soojin and Vogt, Julia E and Ranganath, Rajesh},
  title = {AI as an intervention: improving clinical outcomes relies on a causal approach to AI development and validation},
  journal = {Journal of the American Medical Informatics Association},
  year = {2025},
  volume = {32},
  number = {3},
  pages = {589--594},
  doi = {10.1093/jamia/ocae301}
}
Kostenlos starten →