Can artificial intelligence separate the wheat from the chaff in systematic reviews of health economic articles?
Expert Review of Pharmacoeconomics & Outcomes Research · 21.10.2023 · 23 (9) · 1049-1056
DOI: 10.1080/14737167.2023.2234639 ↗Kurz gefasst
Fachartikel in der Zeitschrift Expert Review of Pharmacoeconomics & Outcomes Research, online erschienen am 13.08.2023. Verfasst von M J Oude Wolcherink und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Health Technology and Services Research, Technical Medical Centre, Faculty of Behavioral, Management and Social Sciences, University of…. Hauptthemen laut MEDLINE: Artificial Intelligence, Economics, Medical. Die Arbeit wurde bisher 47-mal zitiert (Crossref) und nennt 20 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).
Abstract (Originalsprache)
OBJECTIVES: Artificial intelligence-powered tools, such as ASReview, could reduce the burden of title and abstract screening. This study aimed to assess the accuracy and efficiency of using ASReview in a health economic context. METHODS: A sample from a previous systematic literature review containing 4,994 articles was used. Previous manual screening resulted in 134 articles included for full-text screening (FT) and 50 for data extraction (DE). Here, accuracy and efficiency was evaluated by comparing the number of identified relevant articles with ASReview versus manual screening. Pre-defined stopping rules using sampling criteria and heuristic criteria were tested. Robustness of the AI-tool's performance was determined using 1,000 simulations. RESULTS: Considering included stopping rules, median accuracy for FT articles remained below 85%, but reached 100% for DE articles. To identify all relevant articles, a median of 89.9% of FT articles needed to be screened, compared to 7.7% for DE articles. Potential time savings between 49 and 59 hours could be achieved, depending on the stopping rule. CONCLUSIONS: In our case study, all DE articles were identified after screening 7.7% of the sample, allowing for substantial time savings. ASReview likely has the potential to substantially reduce screening time in systematic reviews of health economic articles.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Health Technology and Services Research, Technical Medical Centre, Faculty of Behavioral, Management and Social Sciences, University of Twente, Enschede, The Netherlands.
ORCID-Profile: M J Oude Wolcherink
Zitieren
APA
Oude Wolcherink, M. J., Pouwels, X. G. L. V., van Dijk, S. H. B., Doggen, C. J. M., & Koffijberg, H. (2023). Can artificial intelligence separate the wheat from the chaff in systematic reviews of health economic articles?. Expert Review of Pharmacoeconomics & Outcomes Research, 23(9), 1049-1056. https://doi.org/10.1080/14737167.2023.2234639
Vancouver
Oude Wolcherink MJ, Pouwels XGLV, van Dijk SHB, Doggen CJM, Koffijberg H. Can artificial intelligence separate the wheat from the chaff in systematic reviews of health economic articles?. Expert Review of Pharmacoeconomics & Outcomes Research. 2023;23(9):1049-1056. doi:10.1080/14737167.2023.2234639
BibTeX
@article{OudeWolcherink2023,
author = {Oude Wolcherink, M J and Pouwels, X G L V and van Dijk, S H B and Doggen, C J M and Koffijberg, H},
title = {Can artificial intelligence separate the wheat from the chaff in systematic reviews of health economic articles?},
journal = {Expert Review of Pharmacoeconomics & Outcomes Research},
year = {2023},
volume = {23},
number = {9},
pages = {1049--1056},
doi = {10.1080/14737167.2023.2234639}
}
EUVIMED