Fast‐and‐frugal decision tree for the rapid critical appraisal of systematic reviews
Research Synthesis Methods · 2024-11 · 15 (6) · 1049-1059
DOI: 10.1002/jrsm.1754 ↗Kurz gefasst
Fachartikel in der Zeitschrift Research Synthesis Methods, online erschienen am 05.09.2024. Verfasst von Robert C Lorenz und 3 weiteren Autor:innen. Beteiligte Einrichtung: Center for Environmental Neuroscience, Max Planck Institute for Human Development, Berlin, Germany. Hauptthemen laut MEDLINE: Decision Trees, Systematic Reviews as Topic. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Conducting high‐quality overviews of reviews (OoR) is time‐consuming. Because the quality of systematic reviews (SRs) varies, it is necessary to critically appraise SRs when conducting an OoR. A well‐established appraisal tool is A Measurement Tool to Assess Systematic Reviews (AMSTAR) 2, which takes about 15–32 min per application. To save time, we developed two fast‐and‐frugal decision trees (FFTs) for assessing the methodological quality of SR for OoR either during the full‐text screening stage (Screening FFT) or to the resulting pool of SRs (Rapid Appraisal FFT). To build a data set for developing the FFT, we identified published AMSTAR 2 appraisals. Overall confidence ratings of the AMSTAR 2 were used as a criterion and the 16 items as cues. One thousand five hundred and nineteen appraisals were obtained from 24 publications and divided into training and test data sets. The resulting Screening FFT consists of three items and correctly identifies all non‐critically low‐quality SRs (sensitivity of 100%), but has a positive predictive value of 59%. The three‐item Rapid Appraisal FFT correctly identifies 80% of the high‐quality SRs and correctly identifies 97% of the low‐quality SRs, resulting in an accuracy of 95%. The FFTs require about 10% of the 16 AMSTAR 2 items. The Screening FFT may be applied during full‐text screening to exclude SRs with critically low quality. The Rapid Appraisal FFT may be applied to the final SR pool to identify SR that might be of high methodological quality.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Center for Environmental Neuroscience, Max Planck Institute for Human Development, Berlin, Germany.
- Federal Joint Committee (Healthcare), Berlin, Germany.
- Institute for Planetary Health Behaviour, Health Communication, University of Erfurt, Erfurt, Germany.
- Center for Adaptive Rationality, Max Planck Institute for Human Development, Berlin, Germany.
- Harding Center for Risk Literacy, University of Potsdam, Potsdam, Germany.
- Health Communication Research Group, Implementation Science, Bernhard Nocht Institute for Tropical Medicine, Hamburg, Germany.
ORCID-Profile: Robert C Lorenz, Mirjam Jenny, Anja Jacobs, Katja Matthias
Zitieren
APA
Lorenz, R. C., Jenny, M., Jacobs, A., & Matthias, K. (2024). Fast‐and‐frugal decision tree for the rapid critical appraisal of systematic reviews. Research Synthesis Methods, 15(6), 1049-1059. https://doi.org/10.1002/jrsm.1754
Vancouver
Lorenz RC, Jenny M, Jacobs A, Matthias K. Fast‐and‐frugal decision tree for the rapid critical appraisal of systematic reviews. Research Synthesis Methods. 2024;15(6):1049-1059. doi:10.1002/jrsm.1754
BibTeX
@article{Lorenz2024,
author = {Lorenz, Robert C and Jenny, Mirjam and Jacobs, Anja and Matthias, Katja},
title = {Fast‐and‐frugal decision tree for the rapid critical appraisal of systematic reviews},
journal = {Research Synthesis Methods},
year = {2024},
volume = {15},
number = {6},
pages = {1049--1059},
doi = {10.1002/jrsm.1754}
}
EUVIMED