EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

The inclusion or exclusion of studies based on critical appraisal results in JBI qualitative systematic reviews: An analysis of practices

Romy Menghao Jia iD, Cindy Stern iD

Research Synthesis Methods · 2026-03 · 17 (2) · 277-292

DOI: 10.1017/rsm.2025.10042 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Research Synthesis Methods, online erschienen am 23.10.2025. Verfasst von Romy Menghao Jia und 1 weiteren Autor:innen. Beteiligte Einrichtung: JBI, School of Public Health, https://ror.org/00892tw58The University of Adelaide, Adelaide, SA, Australia. Hauptthemen laut MEDLINE: Qualitative Research, Research Design, Systematic Reviews as Topic. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 56 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Critical appraisal is a core component of JBI qualitative evidence synthesis, offering insights into the quality of included studies and their potential influence on synthesized findings. However, limited guidance exists on whether, when, and how to exclude studies based on appraisal results. This study examined the methods used in JBI qualitative systematic reviews and the implications for synthesized findings. In this study, a systematic analysis of qualitative reviews published between 2018 and 2022 in JBI Evidence Synthesis was conducted. Data on decisions and their justifications were extracted from reviews and protocols. Descriptive and content analysis explored variations in the reported methods. Forty-five reviews were included. Approaches reported varied widely: 24% of reviews included all studies regardless of quality, while others applied exclusion criteria (36%), cutoff scores (11%), or multiple methods (9%). Limited justifications were provided for the approaches. Few reviews cited methodological references to support their decisions. Review authors reported their approach in various sections of the review, with inconsistencies identified in 18% of the sample. In addition, unclear or ambiguous descriptions were also identified in 18% of the included reviews. No clear differences were observed in ConQual scores between reviews that excluded studies and those that did not. Overall, the variability raises concerns about the credibility, transparency, and reproducibility of JBI qualitative systematic reviews. Decisions regarding the inclusion or exclusion of studies based on critical appraisal need to be clearly justified and consistently reported. Further methodological research is needed to support rigorous decision-making and to improve the reliability of synthesized findings.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Qualitative ResearchResearch DesignSystematic Reviews as TopicHumansReproducibility of Results

Stichwörter der Autor:innen

critical appraisalevidence synthesisqualitative systematic reviews

Autor:innen und Institutionen

  • JBI, School of Public Health, https://ror.org/00892tw58The University of Adelaide, Adelaide, SA, Australia.
  • Health Evidence Synthesis, Recommendations and Impact (HESRI), School of Public Health, https://ror.org/00892tw58The University of Adelaide, Adelaide, SA, Australia.

ORCID-Profile: Romy Menghao Jia, Cindy Stern

Zitieren

APA

Jia, R. M., & Stern, C. (2026). The inclusion or exclusion of studies based on critical appraisal results in JBI qualitative systematic reviews: An analysis of practices. Research Synthesis Methods, 17(2), 277-292. https://doi.org/10.1017/rsm.2025.10042

Vancouver

Jia RM, Stern C. The inclusion or exclusion of studies based on critical appraisal results in JBI qualitative systematic reviews: An analysis of practices. Research Synthesis Methods. 2026;17(2):277-292. doi:10.1017/rsm.2025.10042

BibTeX
@article{Jia2026,
  author = {Jia, Romy Menghao and Stern, Cindy},
  title = {The inclusion or exclusion of studies based on critical appraisal results in JBI qualitative systematic reviews: An analysis of practices},
  journal = {Research Synthesis Methods},
  year = {2026},
  volume = {17},
  number = {2},
  pages = {277--292},
  doi = {10.1017/rsm.2025.10042}
}
Kostenlos starten →