Reporting and interpreting non-significant results in animal cognition research
PeerJ · 09.03.2023 · 11 · e14963
DOI: 10.7717/peerj.14963 ↗Kurz gefasst
Fachartikel in der Zeitschrift PeerJ, online erschienen am 09.03.2023. Verfasst von Benjamin G Farrar und 10 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychology, University of Cambridge, Cambridge, United Kingdom. Hauptthemen laut MEDLINE: Research Design, Animal Experimentation. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 51 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Biotechnology and Biological Sciences Research Council, University of Cambridge BBSRC Doctoral Training Programme, BOF fellowship.
Abstract (Originalsprache)
How statistically non-significant results are reported and interpreted following null hypothesis significance testing is often criticized. This issue is important for animal cognition research because studies in the field are often underpowered to detect theoretically meaningful effect sizes, i.e. , often produce non-significant p -values even when the null hypothesis is incorrect. Thus, we manually extracted and classified how researchers report and interpret non-significant p -values and examined the p -value distribution of these non-significant results across published articles in animal cognition and related fields. We found a large amount of heterogeneity in how researchers report statistically non-significant p -values in the result sections of articles, and how they interpret them in the titles and abstracts. Reporting of the non-significant results as “No Effect” was common in the titles (84%), abstracts (64%), and results sections (41%) of papers, whereas reporting of the results as “Non-Significant” was less common in the titles (0%) and abstracts (26%), but was present in the results (52%). Discussions of effect sizes were rare (
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Psychology, University of Cambridge, Cambridge, United Kingdom.
- Institute for Globally Distributed Open Research and Education (IGDORE), Cambridge, United Kingdom.
- Department of Experimental Psychology, Universiteit Gent, Gent, Belgium.
- Department of Psychology, National University of Singapore, Singapore, Singapore.
- Department of Psychology, Faculty of Humanities and Social Sciences, University of Rijeka, Rijeka, Croatia.
- Division of Cognitive Sciences, University of Rijeka, Rijeka, Croatia.
Förderung
- Biotechnology and Biological Sciences Research Council
- University of Cambridge BBSRC Doctoral Training Programme
- BOF fellowship
- DFG Grant
- University of Tübingen Athene Fellowship
- The Baily Thomas Charitable Fund
- MSCA Fellowship
Zitieren
APA
Farrar, B. G., Vernouillet, A., Garcia-Pelegrin, E., Legg, E. W., Brecht, K. F., Lambert, P. J., Elsherif, M., Francis, S., O'Neill, L., Clayton, N. S., & Ostojić, L. (2023). Reporting and interpreting non-significant results in animal cognition research. PeerJ, 11, e14963. https://doi.org/10.7717/peerj.14963
Vancouver
Farrar BG, Vernouillet A, Garcia-Pelegrin E, Legg EW, Brecht KF, Lambert PJ, et al. Reporting and interpreting non-significant results in animal cognition research. PeerJ. 2023;11:e14963. doi:10.7717/peerj.14963
BibTeX
@article{Farrar2023,
author = {Farrar, Benjamin G and Vernouillet, Alizée and Garcia-Pelegrin, Elias and Legg, Edward W and Brecht, Katharina F and Lambert, Poppy J and Elsherif, Mahmoud and Francis, Shannon and O'Neill, Laurie and Clayton, Nicola S and Ostojić, Ljerka},
title = {Reporting and interpreting non-significant results in animal cognition research},
journal = {PeerJ},
year = {2023},
volume = {11},
pages = {e14963},
doi = {10.7717/peerj.14963}
}
EUVIMED