EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Fast‐and‐frugal decision tree for the rapid critical appraisal of systematic reviews

Robert C Lorenz iD, Mirjam Jenny iD, Anja Jacobs iD, Katja Matthias iD

Research Synthesis Methods · 2024-11 · 15 (6) · 1049-1059

DOI: 10.1002/jrsm.1754 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Research Synthesis Methods, online erschienen am 05.09.2024. Verfasst von Robert C Lorenz und 3 weiteren Autor:innen. Beteiligte Einrichtung: Center for Environmental Neuroscience, Max Planck Institute for Human Development, Berlin, Germany. Hauptthemen laut MEDLINE: Decision Trees, Systematic Reviews as Topic. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Conducting high‐quality overviews of reviews (OoR) is time‐consuming. Because the quality of systematic reviews (SRs) varies, it is necessary to critically appraise SRs when conducting an OoR. A well‐established appraisal tool is A Measurement Tool to Assess Systematic Reviews (AMSTAR) 2, which takes about 15–32 min per application. To save time, we developed two fast‐and‐frugal decision trees (FFTs) for assessing the methodological quality of SR for OoR either during the full‐text screening stage (Screening FFT) or to the resulting pool of SRs (Rapid Appraisal FFT). To build a data set for developing the FFT, we identified published AMSTAR 2 appraisals. Overall confidence ratings of the AMSTAR 2 were used as a criterion and the 16 items as cues. One thousand five hundred and nineteen appraisals were obtained from 24 publications and divided into training and test data sets. The resulting Screening FFT consists of three items and correctly identifies all non‐critically low‐quality SRs (sensitivity of 100%), but has a positive predictive value of 59%. The three‐item Rapid Appraisal FFT correctly identifies 80% of the high‐quality SRs and correctly identifies 97% of the low‐quality SRs, resulting in an accuracy of 95%. The FFTs require about 10% of the 16 AMSTAR 2 items. The Screening FFT may be applied during full‐text screening to exclude SRs with critically low quality. The Rapid Appraisal FFT may be applied to the final SR pool to identify SR that might be of high methodological quality.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Decision TreesSystematic Reviews as TopicHumansAlgorithmsEvidence-Based MedicineReproducibility of ResultsResearch Design

Stichwörter der Autor:innen

AMSTAR 2critical appraisaldecision treemethodological qualityoverview of reviews

Autor:innen und Institutionen

  • Center for Environmental Neuroscience, Max Planck Institute for Human Development, Berlin, Germany.
  • Federal Joint Committee (Healthcare), Berlin, Germany.
  • Institute for Planetary Health Behaviour, Health Communication, University of Erfurt, Erfurt, Germany.
  • Center for Adaptive Rationality, Max Planck Institute for Human Development, Berlin, Germany.
  • Harding Center for Risk Literacy, University of Potsdam, Potsdam, Germany.
  • Health Communication Research Group, Implementation Science, Bernhard Nocht Institute for Tropical Medicine, Hamburg, Germany.

ORCID-Profile: Robert C Lorenz, Mirjam Jenny, Anja Jacobs, Katja Matthias

Zitieren

APA

Lorenz, R. C., Jenny, M., Jacobs, A., & Matthias, K. (2024). Fast‐and‐frugal decision tree for the rapid critical appraisal of systematic reviews. Research Synthesis Methods, 15(6), 1049-1059. https://doi.org/10.1002/jrsm.1754

Vancouver

Lorenz RC, Jenny M, Jacobs A, Matthias K. Fast‐and‐frugal decision tree for the rapid critical appraisal of systematic reviews. Research Synthesis Methods. 2024;15(6):1049-1059. doi:10.1002/jrsm.1754

BibTeX
@article{Lorenz2024,
  author = {Lorenz, Robert C and Jenny, Mirjam and Jacobs, Anja and Matthias, Katja},
  title = {Fast‐and‐frugal decision tree for the rapid critical appraisal of systematic reviews},
  journal = {Research Synthesis Methods},
  year = {2024},
  volume = {15},
  number = {6},
  pages = {1049--1059},
  doi = {10.1002/jrsm.1754}
}
Kostenlos starten →