EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Ecological meta‐analyses often produce unwarranted results

Scott D Peacor iD, Chao Song iD, James R Bence, Amy A Briggs, Elizabeth A Hamman iD, Craig W Osenberg iD

Ecology · 2025-12 · 106 (12)

DOI: 10.1002/ecy.70269 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Ecology, online erschienen am 08.12.2025. Verfasst von Scott D Peacor und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Fisheries and Wildlife, Michigan State University, East Lansing, Michigan, USA. Hauptthemen laut MEDLINE: Meta-Analysis as Topic, Ecology, Ecosystem. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 38 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Directorate for Biological Sciences, Division of Ocean Sciences.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Meta‐analysis (MA), a powerful tool for synthesizing reported results, is influential in ecology. While ecologists have long been well‐informed on the potential problems associated with nonindependence in experimental work (e.g., pseudoreplication), they have, until recently, largely neglected this issue in MA. However, results used in MAs are likely much more similar when they come from the same locality, system, or laboratory. A simple and common form of nonindependence in MA arises when multiple data points, that is, observed effect sizes, come from the same paper. We obtained original data from 20 published MAs, reconstructed the published analyses, and then, for 14 that had not accounted for a paper effect, used three approaches to evaluate whether within‐paper nonindependence was a problem. First, we found that “nonsense” explanatory variables added to the original analyses were statistically significant ( p < 0.05) far more often than the expected 5% (25%–50% for four nonsense variables). For example, the number of vowels in the first author's name had a significant effect 50% of the time. Second, we found that an added dummy variable, which was randomly assigned at one of two levels, was statistically significant an average of 38% of the time, far exceeding the expected 5%. Even after including a random paper effect in the analyses, there was still an excess of significant results, suggesting that the within‐paper nonindependence was more complex than modeled with the random paper effect. Third, we repeated the original MAs that did not include random paper effects ( n = 14 MAs) but added a random paper effect to each revised analysis. In 12 out of the 14 MAs, an added random effect was statistically significant (indicating group nonindependence that was not accounted for in the original analyses), and often the original inferences were substantially altered. Further, incorporating random paper effects was not a sufficient solution to nonindependence. Thus, problems resulting from nonindependence are often substantial, and accounting for the problem will likely require careful consideration of the details of the potential dependence among observed effect sizes. MAs that do not properly account for this problem may reach unwarranted conclusions.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Meta-Analysis as TopicEcologyEcosystem

Stichwörter der Autor:innen

hierarchical modelmeta‐analysisnonindependencepseudoreplicationrandom effect

Autor:innen und Institutionen

  • Department of Fisheries and Wildlife, Michigan State University, East Lansing, Michigan, USA.
  • State Key Laboratory of Herbage Improvement and Grassland Agro-ecosystems, College of Ecology, Lanzhou University, Lanzhou, Gansu, People's Republic of China.
  • Department of Evolution and Ecology, UC Davis, Davis, California, USA.
  • Department of Biology, St. Mary's College of Maryland, St. Mary's City, Maryland, USA.
  • Odum School of Ecology, University of Georgia, Athens, Georgia, USA.

ORCID-Profile: Scott D Peacor, Chao Song, Elizabeth A Hamman, Craig W Osenberg

Förderung

  • Directorate for Biological Sciences
  • Division of Ocean Sciences

Zitieren

APA

Peacor, S. D., Song, C., Bence, J. R., Briggs, A. A., Hamman, E. A., & Osenberg, C. W. (2025). Ecological meta‐analyses often produce unwarranted results. Ecology, 106(12). https://doi.org/10.1002/ecy.70269

Vancouver

Peacor SD, Song C, Bence JR, Briggs AA, Hamman EA, Osenberg CW. Ecological meta‐analyses often produce unwarranted results. Ecology. 2025;106(12). doi:10.1002/ecy.70269

BibTeX
@article{Peacor2025,
  author = {Peacor, Scott D and Song, Chao and Bence, James R and Briggs, Amy A and Hamman, Elizabeth A and Osenberg, Craig W},
  title = {Ecological meta‐analyses often produce unwarranted results},
  journal = {Ecology},
  year = {2025},
  volume = {106},
  number = {12},
  doi = {10.1002/ecy.70269}
}
Kostenlos starten →