Guidance for Grading the Evidence in Quantitative Umbrella Reviews
Journal of Evidence-Based Medicine · 2026-06 · 19 (2)
DOI: 10.1111/jebm.70137 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Evidence-Based Medicine, online erschienen am 25.06.2026. Verfasst von Hanan Khalil und 7 weiteren Autor:innen. Beteiligte Einrichtung: Department of Public Health, School of Psychology and Public Health, La Trobe University, Melbourne, Australia. Hauptthemen laut MEDLINE: Evidence-Based Medicine, Systematic Reviews as Topic, GRADE Approach. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 26 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Background
Umbrella reviews (URs) synthesize evidence across multiple systematic reviews and meta‐analyses to inform decision‐making. However, evaluating and integrating evidence certainty across overlapping and sometimes conflicting meta‐analyses remains a major methodological challenge of URs, limiting the reliability of conclusions.
Objective
To compare evidence evaluation frameworks for URs, assess their suitability for different study types, and provide guidance for managing overlapping evidence, conflicting certainty ratings, and forming overall conclusions.
Methods
We mapped published UR methods to identify current practices and gaps. Frameworks were compared across three dimensions: applicability to study types (interventional, causal observational, and descriptive observational), scalability and reproducibility, and capacity to handle methodological challenges specific to URs. Recommendations were developed through expert consensus and validated via case studies across diverse domains.
Results
Grading of Recommendations Assessment, Development and Evaluation (GRADE) is widely accepted for interventional evidence but shows limited applicability for observational URs due to subjective judgments and reproducibility issues. Credibility frameworks, based on predefined statistical thresholds, offer greater scalability and reproducibility but require adaptation for different study types. Key challenges include: (1) managing overlapping primary studies, (2) resolving conflicting certainty ratings between high‐quality reviews, and (3) ensuring transparent evidence integration.
Conclusions
Framework selection should be tailored to study type and context, with credibility frameworks better suited for observational evidence and GRADE optimal for interventional studies. Systematic approaches to overlapping evidence and conflicting ratings are essential for UR validity. We provide practical recommendations for framework selection, strategies for common challenges, and enhanced reporting standards to improve transparency and reproducibility.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Public Health, School of Psychology and Public Health, La Trobe University, Melbourne, Australia.
- School of Nursing and Midwifery, University of Newcastle, Newcastle, Australia.
- Faculty of Nursing, Chiang Mai University, Chiang Mai, Thailand.
- School of Nursing, Queen's University, Kingston, Canada.
- Faculty of Health Sciences Brandenburg, Brandenburg Medical School (Theodor Fontane), Neuruppin, Germany.
- JBI, Faculty of Health and Medical Sciences, The University of Adelaide, Adelaide, Australia.
Zitieren
APA
Khalil, H., Fernandez, R., Bhatarasakoon, P., Sears, K., Piper, D., Stone, J., Stern, C., & Kynoch, K. (2026). Guidance for Grading the Evidence in Quantitative Umbrella Reviews. Journal of Evidence-Based Medicine, 19(2). https://doi.org/10.1111/jebm.70137
Vancouver
Khalil H, Fernandez R, Bhatarasakoon P, Sears K, Piper D, Stone J, et al. Guidance for Grading the Evidence in Quantitative Umbrella Reviews. Journal of Evidence-Based Medicine. 2026;19(2). doi:10.1111/jebm.70137
BibTeX
@article{Khalil2026,
author = {Khalil, Hanan and Fernandez, Ritin and Bhatarasakoon, Patraporn and Sears, Kim and Piper, Dawid and Stone, Jennifer and Stern, Cindy and Kynoch, Kate},
title = {Guidance for Grading the Evidence in Quantitative Umbrella Reviews},
journal = {Journal of Evidence-Based Medicine},
year = {2026},
volume = {19},
number = {2},
doi = {10.1111/jebm.70137}
}
EUVIMED