Faster but Not Truer, Part 1: A Systematic Scoping Review of Artificial Intelligence in Health Economics and Outcomes Research
Schneller, aber nicht wahrer, Teil 1: Systematische Scoping-Review zu künstlicher Intelligenz in Health Economics and Outcomes Research
Journal of Health Economics and Outcomes Research · 15.10.2026 · 13 (2)
DOI: 10.36469/001c.171937 ↗Auf einen Blick
Die Scoping-Review zeigt eine starke Zunahme von KI-Publikationen in HEOR. Zugleich war nur etwa die Hälfte der geprüften Treffer tatsächlich HEOR-relevant.
Fragestellung
Wie hat sich der Einsatz von KI in HEOR-Publikationen seit 2010 entwickelt, und wie genau sind die Zuordnungen der Treffer?
Methode
Systematische Scoping-Review nach PRISMA-ScR; PubMed-Suche 2010 bis 2025; 2642 Treffer, 2476 eingeschlossen; Klassifikation in 8 Anwendungsdomänen und 6 Methodenkategorien; Validierung mit 300 zufälligen Datensätzen.
Ergebnisse
Eingeschlossene Publikationen stiegen von 29 in 2010 auf 852 in 2025. 154/300 (51,3 %; 95 %-KI 45,7–56,9) waren wirklich HEOR-relevant; precision-adjusted corpus size 1271 (95 %-KI 1131–1410).
Einschränkungen
Keine
Schlussfolgerung der Autor:innen
Die Literatur wächst schneller als ihre Messinfrastruktur. Messbare Gewinne konzentrieren sich auf Aufgaben mit beobachtbarem Ground Truth; prädiktive Leistung sagt evidenzielle Leistung wiederholt nicht voraus.
Kernaussagen
- Publikationen: 29 in 2010, 852 in 2025
- Nur 51,3 % der geprüften Treffer waren HEOR-relevant
- Kappa reichte von 0,729 bis 0,144 je nach Domäne
Deutsche Zusammenfassung: KI-gestützt aus dem Original-Abstract erstellt; alle Zahlen wurden automatisch mit dem Original abgeglichen. Maßgeblich ist der Original-Abstract.
Kurz gefasst
Systematische Übersicht in der Zeitschrift Journal of Health Economics and Outcomes Research, online erschienen am 15.10.2026. Verfasst von Onur Baser. Beteiligte Einrichtung: Graduate School of Public Health City University of New York, New York, USA. Die Arbeit nennt 89 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Background
Artificial intelligence (AI) is being introduced into every stage of the health economics and outcomes research (HEOR) production line, from literature screening to causal estimation. The field lacks a defensible count of what has been done, and bibliometric claims about AI adoption circulate without measured error rates.
Methods
Following PRISMA-ScR, we searched PubMed for AI terms co-occurring with HEOR terms for publications from 2010 through 2025, retrieved 2642 records, and included 2476 after screening. Records were classified into 8 nonexclusive application domains and 1 of 6 method categories using a published term dictionary. To quantify classification error, an independent large language model classifier, blinded to the dictionary labels and given only title and abstract, reclassified a random sample of 300 included records. We report per label counts, agreement, Cohen kappa, prevalence-adjusted bias-adjusted kappa, precision, recall, F1, and a precision-adjusted corpus size with exact binomial intervals. We separately assembled the primary performance evidence for each HEOR workflow, requiring a quantitative metric from a primary study.
Results
Included publications rose from 29 in 2010 to 852 in 2025, a factor of 29.4, with the inflection at 2018 to 2019 rather than at the release of ChatGPT. AI reached 6.0% of all indexed HEOR output in 2025 while HEOR fell to 0.86% of all indexed medical AI output. Economic evaluation was the most frequently assigned domain (1559/2476, 63.0%), followed by real-world data and causal inference (496, 20.0%) and governance, reporting, and validity (494, 20.0%). Generative AI appeared in no record before 2021 and in 103 in 2025. Only 154 of 300 sampled records (51.3%; 95% confidence interval [CI], 45.7-56.9) were judged genuinely HEOR relevant, implying a precision-adjusted corpus of 1271 studies (95% CI 1131-1410). Agreement was substantial for real-world data and causal inference (kappa, 0.729) but negligible for economic evaluation (kappa, 0.144), where dictionary precision was 29.6%. Of 2476 records, 38 (1.5%) were randomized trials and 17 (0.7%) validation studies. The replication package (https://github.com/obaser3791/ai-heor-scoping-review) is publicly available.
Conclusions
The literature is growing faster than its own measurement infrastructure. Measured gains concentrate in tasks with observable ground truth, and predictive performance repeatedly fails to predict evidentiary performance.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Graduate School of Public Health City University of New York, New York, USA.
ORCID-Profile: Onur Baser
Zitieren
APA
Baser, O. (2026). Faster but Not Truer, Part 1: A Systematic Scoping Review of Artificial Intelligence in Health Economics and Outcomes Research. Journal of Health Economics and Outcomes Research, 13(2). https://doi.org/10.36469/001c.171937
Vancouver
Baser O. Faster but Not Truer, Part 1: A Systematic Scoping Review of Artificial Intelligence in Health Economics and Outcomes Research. Journal of Health Economics and Outcomes Research. 2026;13(2). doi:10.36469/001c.171937
BibTeX
@article{Baser2026,
author = {Baser, Onur},
title = {Faster but Not Truer, Part 1: A Systematic Scoping Review of Artificial Intelligence in Health Economics and Outcomes Research},
journal = {Journal of Health Economics and Outcomes Research},
year = {2026},
volume = {13},
number = {2},
doi = {10.36469/001c.171937}
}
EUVIMED