EUVIMEDEUVIMED entdecken
Open Access

Prediction Performance of Earlier Studies for Later Studies in Cochrane Reviews

Fahad M Al Amer, Lifeng Lin iD

Journal of Evaluation in Clinical Practice · 2025

DOI: 10.1111/jep.70172 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Evaluation in Clinical Practice, 2025. Verfasst von Fahad M Al Amer und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Mathematics, College of Science and Arts, Najran University, Najran, Saudi Arabia. Hauptthemen laut MEDLINE: Meta-Analysis as Topic, Review Literature as Topic. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 32 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: NIA NIH HHS, Fahad M. Al Amer was supported by the Deanship of Graduate Studies and Scientific Research at Najran University grant code (NU/EFP/SERC/13/1). Lifeng Lin was s…, NLM NIH HHS.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Rationale

Between‐study heterogeneity poses challenges to the generalisability of meta‐analytical results, which can influence their ability to predict outcomes in future studies. Prediction intervals have been proposed to account for both uncertainty and heterogeneity, yet their real‐world performance in predicting future studies has not been systematically evaluated. Aims and Objectives This study aims to assess the prediction performance of meta‐analyses, focusing on how effectively they predict later study results based on meta‐analyses of earlier studies.

Methods

This empirical study used a comprehensive collection of meta‐analyses from the Cochrane Database of Systematic Reviews. Through in‐sample evaluation, the success of predicting later study results was assessed based on meta‐analyses of earlier studies in Cochrane reviews. The impact of factors such as the number of studies in the meta‐analysis and uncertainties in heterogeneity estimation was also analysed.

Results

The findings reveal that prediction failures are common, particularly as the number of studies in the meta‐analysis increases. This may be attributed to uncertainties in estimating between‐study heterogeneity. Conversely, when the number of studies is small, the proportion of successful predictions is high. However, this is likely due to large uncertainties in predictions and the limited information provided by fewer studies, which may reduce their utility in providing valuable evidence for future studies.

Conclusions

These results underscore the importance of cautious interpretation and further investigation when applying meta‐analytical findings to future studies. Our findings suggest several potential strategies for predicting future study results through evidence synthesis, with particular emphasis on carefully considering between‐study heterogeneity, the number of studies included in a meta‐analysis, and the temporal trends in individual study results.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Meta-Analysis as TopicReview Literature as TopicHumansUncertaintyForecasting

Stichwörter der Autor:innen

Cochrane reviewheterogeneitymeta‐analysispredictionsystematic review

Autor:innen und Institutionen

  • Department of Mathematics, College of Science and Arts, Najran University, Najran, Saudi Arabia.
  • Department of Epidemiology and Biostatistics, University of Arizona, Tucson, Arizona, USA.

ORCID-Profile: Lifeng Lin

Förderung

  • NIA NIH HHS
  • Fahad M. Al Amer was supported by the Deanship of Graduate Studies and Scientific Research at Najran University grant code (NU/EFP/SERC/13/1). Lifeng Lin was s…
  • NLM NIH HHS
  • NIMH NIH HHS
  • Najran University

Zitieren

APA

Al Amer, F. M., & Lin, L. (2025). Prediction Performance of Earlier Studies for Later Studies in Cochrane Reviews. Journal of Evaluation in Clinical Practice. https://doi.org/10.1111/jep.70172

Vancouver

Al Amer FM, Lin L. Prediction Performance of Earlier Studies for Later Studies in Cochrane Reviews. Journal of Evaluation in Clinical Practice. 2025. doi:10.1111/jep.70172

BibTeX
@article{AlAmer2025,
  author = {Al Amer, Fahad M and Lin, Lifeng},
  title = {Prediction Performance of Earlier Studies for Later Studies in Cochrane Reviews},
  journal = {Journal of Evaluation in Clinical Practice},
  year = {2025},
  doi = {10.1111/jep.70172}
}
Kostenlos starten →