Reliability of meta-analyses in ecology and evolution: (mostly) good news from a case study on sexual signals
Proceedings of the Royal Society B: Biological Sciences · 2025
DOI: 10.1098/rspb.2024.2782 ↗Kurz gefasst
Metaanalyse in der Zeitschrift Proceedings of the Royal Society B: Biological Sciences, 2025. Verfasst von Pietro Pollo und 5 weiteren Autor:innen. Beteiligte Einrichtung: Evolution & Ecology Research Centre, School of Biological, Earth & Environmental Sciences, University of New South Wales, Kensington, New South Wales…. Hauptthemen laut MEDLINE: Meta-Analysis as Topic, Ecology, Biological Evolution, Animal Communication. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 88 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Canada Excellence Research Chair Program, Coordenação de Aperfeiçoamento de Pessoal de Nível Superior, Australian Research Council.
Abstract (Originalsprache)
Meta-analyses are powerful synthesis tools that are popular in ecology and evolution owing to the rapidly growing literature of this field. Although the usefulness of meta-analyses depends on their reliability, such as the precision of individual and mean effect sizes, attempts to reproduce meta-analyses’ results remain rare in ecology and evolution. Here, we assess the reliability of 41 meta-analyses on sexual signals by evaluating the reproducibility and replicability of their results. We attempted to: (i) reproduce meta-analyses’ mean effect sizes using the datasets they provided; (ii) reproduce meta-analyses’ effect sizes by re-extracting 5703 effect sizes from 246 primary studies they used as sources; (iii) assess the extent of relevant data missed by original meta-analyses; and (iv) replicate meta-analyses’ mean effect sizes after incorporating re-extracted and relevant missing data. We found many discrepancies between meta-analyses’ reported results and those generated by our analyses for all reproducibility and replicability attempts. Nonetheless, we argue that the meta-analyses we evaluated are largely reproducible and replicable because the differences we found were small in magnitude, leaving the original interpretation of these meta-analyses’ results unchanged. Still, we highlight issues we observed in these meta-analyses that affected their reliability, providing recommendations to ameliorate them.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Evolution & Ecology Research Centre, School of Biological, Earth & Environmental Sciences, University of New South Wales, Kensington, New South Wales, Australia.
- Departamento de Biologia Geral, Universidade Federal de Viçosa, Viçosa, Minas Gerais, Brazil.
- Department of Biological Sciences, University of Alberta, Edmonton, Alberta, Canada.
ORCID-Profile: Pietro Pollo, Malgorzata Lagisz, Renato C Macedo-Rego, Ayumi Mizuno, Yefeng Yang, Shinichi Nakagawa
Förderung
- Canada Excellence Research Chair Program
- Coordenação de Aperfeiçoamento de Pessoal de Nível Superior
- Australian Research Council
Zitieren
APA
Pollo, P., Lagisz, M., Macedo-Rego, R. C., Mizuno, A., Yang, Y., & Nakagawa, S. (2025). Reliability of meta-analyses in ecology and evolution: (mostly) good news from a case study on sexual signals. Proceedings of the Royal Society B: Biological Sciences. https://doi.org/10.1098/rspb.2024.2782
Vancouver
Pollo P, Lagisz M, Macedo-Rego RC, Mizuno A, Yang Y, Nakagawa S. Reliability of meta-analyses in ecology and evolution: (mostly) good news from a case study on sexual signals. Proceedings of the Royal Society B: Biological Sciences. 2025. doi:10.1098/rspb.2024.2782
BibTeX
@article{Pollo2025,
author = {Pollo, Pietro and Lagisz, Malgorzata and Macedo-Rego, Renato C and Mizuno, Ayumi and Yang, Yefeng and Nakagawa, Shinichi},
title = {Reliability of meta-analyses in ecology and evolution: (mostly) good news from a case study on sexual signals},
journal = {Proceedings of the Royal Society B: Biological Sciences},
year = {2025},
doi = {10.1098/rspb.2024.2782}
}
EUVIMED