EUVIMEDEUVIMED entdecken
Systematische ÜbersichtScoping ReviewOpen Access · CC BY 4.0

Faster but Not Truer, Part 1: A Systematic Scoping Review of Artificial Intelligence in Health Economics and Outcomes Research

Schneller, aber nicht wahrer, Teil 1: Systematische Scoping-Review zu künstlicher Intelligenz in Health Economics and Outcomes Research

Onur Baser iD

Journal of Health Economics and Outcomes Research · 15.10.2026 · 13 (2)

DOI: 10.36469/001c.171937 ↗

Auf einen Blick

Die Scoping-Review zeigt eine starke Zunahme von KI-Publikationen in HEOR. Zugleich war nur etwa die Hälfte der geprüften Treffer tatsächlich HEOR-relevant.

Fragestellung

Wie hat sich der Einsatz von KI in HEOR-Publikationen seit 2010 entwickelt, und wie genau sind die Zuordnungen der Treffer?

Methode

Systematische Scoping-Review nach PRISMA-ScR; PubMed-Suche 2010 bis 2025; 2642 Treffer, 2476 eingeschlossen; Klassifikation in 8 Anwendungsdomänen und 6 Methodenkategorien; Validierung mit 300 zufälligen Datensätzen.

Ergebnisse

Eingeschlossene Publikationen stiegen von 29 in 2010 auf 852 in 2025. 154/300 (51,3 %; 95 %-KI 45,7–56,9) waren wirklich HEOR-relevant; precision-adjusted corpus size 1271 (95 %-KI 1131–1410).

Einschränkungen

Keine

Schlussfolgerung der Autor:innen

Die Literatur wächst schneller als ihre Messinfrastruktur. Messbare Gewinne konzentrieren sich auf Aufgaben mit beobachtbarem Ground Truth; prädiktive Leistung sagt evidenzielle Leistung wiederholt nicht voraus.

Kernaussagen

  • Publikationen: 29 in 2010, 852 in 2025
  • Nur 51,3 % der geprüften Treffer waren HEOR-relevant
  • Kappa reichte von 0,729 bis 0,144 je nach Domäne

Deutsche Zusammenfassung: KI-gestützt aus dem Original-Abstract erstellt; alle Zahlen wurden automatisch mit dem Original abgeglichen. Maßgeblich ist der Original-Abstract.

Kurz gefasst

Systematische Übersicht in der Zeitschrift Journal of Health Economics and Outcomes Research, online erschienen am 15.10.2026. Verfasst von Onur Baser. Beteiligte Einrichtung: Graduate School of Public Health City University of New York, New York, USA. Die Arbeit nennt 89 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

Auf einen BlickAbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Artificial intelligence (AI) is being introduced into every stage of the health economics and outcomes research (HEOR) production line, from literature screening to causal estimation. The field lacks a defensible count of what has been done, and bibliometric claims about AI adoption circulate without measured error rates.

Methods

Following PRISMA-ScR, we searched PubMed for AI terms co-occurring with HEOR terms for publications from 2010 through 2025, retrieved 2642 records, and included 2476 after screening. Records were classified into 8 nonexclusive application domains and 1 of 6 method categories using a published term dictionary. To quantify classification error, an independent large language model classifier, blinded to the dictionary labels and given only title and abstract, reclassified a random sample of 300 included records. We report per label counts, agreement, Cohen kappa, prevalence-adjusted bias-adjusted kappa, precision, recall, F1, and a precision-adjusted corpus size with exact binomial intervals. We separately assembled the primary performance evidence for each HEOR workflow, requiring a quantitative metric from a primary study.

Results

Included publications rose from 29 in 2010 to 852 in 2025, a factor of 29.4, with the inflection at 2018 to 2019 rather than at the release of ChatGPT. AI reached 6.0% of all indexed HEOR output in 2025 while HEOR fell to 0.86% of all indexed medical AI output. Economic evaluation was the most frequently assigned domain (1559/2476, 63.0%), followed by real-world data and causal inference (496, 20.0%) and governance, reporting, and validity (494, 20.0%). Generative AI appeared in no record before 2021 and in 103 in 2025. Only 154 of 300 sampled records (51.3%; 95% confidence interval [CI], 45.7-56.9) were judged genuinely HEOR relevant, implying a precision-adjusted corpus of 1271 studies (95% CI 1131-1410). Agreement was substantial for real-world data and causal inference (kappa, 0.729) but negligible for economic evaluation (kappa, 0.144), where dictionary precision was 29.6%. Of 2476 records, 38 (1.5%) were randomized trials and 17 (0.7%) validation studies. The replication package (https://github.com/obaser3791/ai-heor-scoping-review) is publicly available.

Conclusions

The literature is growing faster than its own measurement infrastructure. Measured gains concentrate in tasks with observable ground truth, and predictive performance repeatedly fails to predict evidentiary performance.

Schlagwörter

Stichwörter der Autor:innen

artificial intelligencecausal inferencehealth economics outcomes researchhealth technology assessmentmachine learningreal-world evidence

Autor:innen und Institutionen

  • Graduate School of Public Health City University of New York, New York, USA.

ORCID-Profile: Onur Baser

Zitieren

APA

Baser, O. (2026). Faster but Not Truer, Part 1: A Systematic Scoping Review of Artificial Intelligence in Health Economics and Outcomes Research. Journal of Health Economics and Outcomes Research, 13(2). https://doi.org/10.36469/001c.171937

Vancouver

Baser O. Faster but Not Truer, Part 1: A Systematic Scoping Review of Artificial Intelligence in Health Economics and Outcomes Research. Journal of Health Economics and Outcomes Research. 2026;13(2). doi:10.36469/001c.171937

BibTeX
@article{Baser2026,
  author = {Baser, Onur},
  title = {Faster but Not Truer, Part 1: A Systematic Scoping Review of Artificial Intelligence in Health Economics and Outcomes Research},
  journal = {Journal of Health Economics and Outcomes Research},
  year = {2026},
  volume = {13},
  number = {2},
  doi = {10.36469/001c.171937}
}
Kostenlos starten →