EUVIMEDEUVIMED entdecken
Open Access

Health artificial intelligence is here, but are we measuring what matters?

Philip R O Payne iD, Thomas Kannampallil iD, Margaret Lozovatsky

Journal of the American Medical Informatics Association · 2026

DOI: 10.1093/jamia/ocag153 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of the American Medical Informatics Association, 2026. Verfasst von Philip R O Payne und 2 weiteren Autor:innen. Beteiligte Einrichtung: Institute for Informatics, Data Science and Biostatistics, Washington University in St. Louis School of Medicine, St. Louis, MO 63110, United States. Hauptthemen laut MEDLINE: Artificial Intelligence, Outcome Assessment, Health Care. Die Arbeit nennt 13 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Artificial intelligence (AI) is increasingly being used in healthcare settings, yet evidence of its real-world value remains inconsistent. Current evaluation paradigms often emphasize methodological rigor and technical validity over measurable improvements in patient outcomes or system performance.

Objective

To examine limitations in prevailing approaches to health AI evaluation and propose a framework prioritizing outcomes-based, systems-level assessment aligned with healthcare delivery goals.

Methods

This perspective analyzes current evaluation practices through conceptual and ethical lenses, contrasting a deontological focus on methodological standards with a consequentialist framework emphasizing real-world impact.

Results

A persistent gap exists between how AI systems are evaluated and how their value is realized. Technical metrics are necessary but insufficient; meaningful evaluation requires measuring clinical and operational outcomes. Strategies include standardized outcome frameworks, evaluation infrastructure, multistakeholder governance, and aligned incentives.

Conclusions

Advancing health AI requires shifting from process-focused evaluation toward outcome-based assessment embedded within healthcare systems.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Artificial IntelligenceOutcome Assessment, Health CareHumansDelivery of Health Care

Stichwörter der Autor:innen

artificial intelligencehealthcaremedical informaticsoutcome assessmentquality of healthcare

Autor:innen und Institutionen

  • Institute for Informatics, Data Science and Biostatistics, Washington University in St. Louis School of Medicine, St. Louis, MO 63110, United States.
  • Department of Medicine, Washington University in St. Louis School of Medicine, St. Louis, MO 63110, United States.
  • Department of Anesthesiology, Washington University in St. Louis School of Medicine, St. Louis, MO 63110, United States.
  • Premier Health, Dayton, OH 45402, United States.

ORCID-Profile: Philip R O Payne, Thomas Kannampallil

Zitieren

APA

Payne, P. R. O., Kannampallil, T., & Lozovatsky, M. (2026). Health artificial intelligence is here, but are we measuring what matters?. Journal of the American Medical Informatics Association. https://doi.org/10.1093/jamia/ocag153

Vancouver

Payne PRO, Kannampallil T, Lozovatsky M. Health artificial intelligence is here, but are we measuring what matters?. Journal of the American Medical Informatics Association. 2026. doi:10.1093/jamia/ocag153

BibTeX
@article{Payne2026,
  author = {Payne, Philip R O and Kannampallil, Thomas and Lozovatsky, Margaret},
  title = {Health artificial intelligence is here, but are we measuring what matters?},
  journal = {Journal of the American Medical Informatics Association},
  year = {2026},
  doi = {10.1093/jamia/ocag153}
}
Kostenlos starten →