Health artificial intelligence is here, but are we measuring what matters?
Journal of the American Medical Informatics Association · 2026
DOI: 10.1093/jamia/ocag153 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of the American Medical Informatics Association, 2026. Verfasst von Philip R O Payne und 2 weiteren Autor:innen. Beteiligte Einrichtung: Institute for Informatics, Data Science and Biostatistics, Washington University in St. Louis School of Medicine, St. Louis, MO 63110, United States. Hauptthemen laut MEDLINE: Artificial Intelligence, Outcome Assessment, Health Care. Die Arbeit nennt 13 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Background
Artificial intelligence (AI) is increasingly being used in healthcare settings, yet evidence of its real-world value remains inconsistent. Current evaluation paradigms often emphasize methodological rigor and technical validity over measurable improvements in patient outcomes or system performance.
Objective
To examine limitations in prevailing approaches to health AI evaluation and propose a framework prioritizing outcomes-based, systems-level assessment aligned with healthcare delivery goals.
Methods
This perspective analyzes current evaluation practices through conceptual and ethical lenses, contrasting a deontological focus on methodological standards with a consequentialist framework emphasizing real-world impact.
Results
A persistent gap exists between how AI systems are evaluated and how their value is realized. Technical metrics are necessary but insufficient; meaningful evaluation requires measuring clinical and operational outcomes. Strategies include standardized outcome frameworks, evaluation infrastructure, multistakeholder governance, and aligned incentives.
Conclusions
Advancing health AI requires shifting from process-focused evaluation toward outcome-based assessment embedded within healthcare systems.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Institute for Informatics, Data Science and Biostatistics, Washington University in St. Louis School of Medicine, St. Louis, MO 63110, United States.
- Department of Medicine, Washington University in St. Louis School of Medicine, St. Louis, MO 63110, United States.
- Department of Anesthesiology, Washington University in St. Louis School of Medicine, St. Louis, MO 63110, United States.
- Premier Health, Dayton, OH 45402, United States.
ORCID-Profile: Philip R O Payne, Thomas Kannampallil
Zitieren
APA
Payne, P. R. O., Kannampallil, T., & Lozovatsky, M. (2026). Health artificial intelligence is here, but are we measuring what matters?. Journal of the American Medical Informatics Association. https://doi.org/10.1093/jamia/ocag153
Vancouver
Payne PRO, Kannampallil T, Lozovatsky M. Health artificial intelligence is here, but are we measuring what matters?. Journal of the American Medical Informatics Association. 2026. doi:10.1093/jamia/ocag153
BibTeX
@article{Payne2026,
author = {Payne, Philip R O and Kannampallil, Thomas and Lozovatsky, Margaret},
title = {Health artificial intelligence is here, but are we measuring what matters?},
journal = {Journal of the American Medical Informatics Association},
year = {2026},
doi = {10.1093/jamia/ocag153}
}
EUVIMED