Big little lies: a compendium and simulation of p -hacking strategies
Royal Society Open Science · 2023-02 · 10 (2)
DOI: 10.1098/rsos.220346 ↗Kurz gefasst
Fachartikel in der Zeitschrift Royal Society Open Science, online erschienen am 08.02.2023. Verfasst von Angelika M Stefan und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychology, University of Amsterdam, Amsterdam, The Netherlands. Die Arbeit wurde bisher 117-mal zitiert (Crossref) und nennt 121 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: Nederlandse Organisatie voor Wetenschappelijk Onderzoek.
Abstract (Originalsprache)
In many research fields, the widespread use of questionable research practices has jeopardized the credibility of scientific results. One of the most prominent questionable research practices is p -hacking. Typically, p -hacking is defined as a compound of strategies targeted at rendering non-significant hypothesis testing results significant. However, a comprehensive overview of these p -hacking strategies is missing, and current meta-scientific research often ignores the heterogeneity of strategies. Here, we compile a list of 12 p -hacking strategies based on an extensive literature review, identify factors that control their level of severity, and demonstrate their impact on false-positive rates using simulation studies. We also use our simulation results to evaluate several approaches that have been proposed to mitigate the influence of questionable research practices. Our results show that investigating p -hacking at the level of strategies can provide a better understanding of the process of p -hacking, as well as a broader basis for developing effective countermeasures. By making our analyses available through a Shiny app and R package, we facilitate future meta-scientific research aimed at investigating the ramifications of p -hacking across multiple strategies, and we hope to start a broader discussion about different manifestations of p -hacking in practice.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Psychology, University of Amsterdam, Amsterdam, The Netherlands.
- Department of Psychology, Universität der Bundeswehr München, München, Germany.
- Department of Psychology, Ludwig-Maximilians-Universität München, Munchen, Germany.
ORCID-Profile: Angelika M Stefan
Förderung
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek
Zitieren
APA
Stefan, A. M., & Schönbrodt, F. D. (2023). Big little lies: a compendium and simulation of p -hacking strategies. Royal Society Open Science, 10(2). https://doi.org/10.1098/rsos.220346
Vancouver
Stefan AM, Schönbrodt FD. Big little lies: a compendium and simulation of p -hacking strategies. Royal Society Open Science. 2023;10(2). doi:10.1098/rsos.220346
BibTeX
@article{Stefan2023,
author = {Stefan, Angelika M and Schönbrodt, Felix D},
title = {Big little lies: a compendium and simulation of p -hacking strategies},
journal = {Royal Society Open Science},
year = {2023},
volume = {10},
number = {2},
doi = {10.1098/rsos.220346}
}
EUVIMED