EUVIMEDEUVIMED entdecken
MetaanalyseOpen Access · CC BY 4.0

Statistical fragility in the meta-analytic evidence base of animal cognition: a meta-meta-analytic reappraisal

Ayumi Mizuno iD, Pietro Pollo iD, Malgorzata Lagisz iD, Lauren Guillette iD, Masayo Soma iD, Shinichi Nakagawa iD

Biology Open · 15.11.2026 · 15 (11)

DOI: 10.1242/bio.062841 ↗

Kurz gefasst

Metaanalyse in der Zeitschrift Biology Open, online erschienen am 13.11.2026. Verfasst von Ayumi Mizuno und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Biological Sciences, Faculty of Science, University of Alberta, Edmonton, AB, T6G 2E9 Canada. Hauptthemen laut MEDLINE: Cognition. Die Arbeit nennt 84 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Canada Excellence Research Chairs, Government of Canada, Australian Research Council, Natural Sciences and Engineering Research Council of Canada.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

How reliable is the meta-analytic evidence base in animal cognition? We conducted a pre-registered second-order meta-analysis of 28 published meta-analytical papers, comprising 48 eligible models and 5740 effect-size observations from primary studies. We assessed statistical power, Type M magnitude error, and Type S sign error at both primary-study and meta-analysis levels. Because these quantities depend on the assumed underlying effect, we compared the results based on uncorrected pooled effects, a regression-based bias correction, and a sensitivity analysis using a bias-robust fixed-effect model incorporating a within-study variance-covariance matrix (FE+VCV). At the primary-study level, estimated power was low under all three empirically estimated effect proxies: 17.4%, 9.0%, and 13.4%, respectively. Type M and Type S errors were also sensitive to the assumed effect and correction method. Power increased when larger externally specified effects were assumed, confirming that these quantities are conditional on the assumed effect. Meta-analysis-level results were generally more favourable but also sensitive to analytical choices. The evidence base was concentrated in experimental rodent studies of learning and memory, limiting field-wide generalisation. These findings support improving study design and reporting within the represented literature while expanding meta-analytic coverage across taxa and cognitive domains.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

CognitionAnimalsMemory

Stichwörter der Autor:innen

Comparative psychologyEvidence synthesisMeta-researchQuantitative synthesisReplication crisisResearch methodology

Autor:innen und Institutionen

  • Department of Biological Sciences, Faculty of Science, University of Alberta, Edmonton, AB, T6G 2E9 Canada.
  • Evolution & Ecology Research Centre, School of Biological, Earth and Environmental Sciences, University of New South Wales, Sydney, NSW, 2052 Australia.
  • School of Environmental and Life Sciences, University of Newcastle, Callaghan, NSW, 2308 Australia.
  • Department of Psychology, Faculty of Science, University of Alberta, Edmonton, AB, T6G 2E9 Canada.
  • Department of Biology, Faculty of Science, Hokkaido University, Sapporo, Hokkaido, 060-0810 Japan.

ORCID-Profile: Ayumi Mizuno, Pietro Pollo, Malgorzata Lagisz, Lauren Guillette, Masayo Soma, Shinichi Nakagawa

Förderung

  • Canada Excellence Research Chairs, Government of Canada
  • Australian Research Council
  • Natural Sciences and Engineering Research Council of Canada
  • Canada Research Chairs
  • University of Alberta

Zitieren

APA

Mizuno, A., Pollo, P., Lagisz, M., Guillette, L., Soma, M., & Nakagawa, S. (2026). Statistical fragility in the meta-analytic evidence base of animal cognition: a meta-meta-analytic reappraisal. Biology Open, 15(11). https://doi.org/10.1242/bio.062841

Vancouver

Mizuno A, Pollo P, Lagisz M, Guillette L, Soma M, Nakagawa S. Statistical fragility in the meta-analytic evidence base of animal cognition: a meta-meta-analytic reappraisal. Biology Open. 2026;15(11). doi:10.1242/bio.062841

BibTeX
@article{Mizuno2026,
  author = {Mizuno, Ayumi and Pollo, Pietro and Lagisz, Malgorzata and Guillette, Lauren and Soma, Masayo and Nakagawa, Shinichi},
  title = {Statistical fragility in the meta-analytic evidence base of animal cognition: a meta-meta-analytic reappraisal},
  journal = {Biology Open},
  year = {2026},
  volume = {15},
  number = {11},
  doi = {10.1242/bio.062841}
}
Kostenlos starten →