EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

P ‐hacking in meta‐analyses: A formalization and new meta‐analytic methods

Maya B Mathur iD

Research Synthesis Methods · 2024

DOI: 10.1002/jrsm.1701 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Research Synthesis Methods, 2024. Verfasst von Maya B Mathur. Beteiligte Einrichtung: Quantitative Sciences Unit, Department of Medicine, Stanford University, Stanford, California, USA. Hauptthemen laut MEDLINE: Meta-Analysis as Topic, Publication Bias, Algorithms, Models, Statistical. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 66 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: NLM NIH HHS, NIH HHS, NIDDK NIH HHS.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

As traditionally conceived, publication bias arises from selection operating on a collection of individually unbiased estimates. A canonical form of such selection across studies (SAS) is the preferential publication of affirmative studies (i.e., those with significant, positive estimates) versus nonaffirmative studies (i.e., those with nonsignificant or negative estimates). However, meta‐analyses can also be compromised by selection within studies (SWS), in which investigators “ p ‐hack” results within their study to obtain an affirmative estimate. Published estimates can then be biased even conditional on affirmative status, which comprises the performance of existing methods that only consider SAS. We propose two new analysis methods that accommodate joint SAS and SWS; both analyze only the published nonaffirmative estimates. First, we propose estimating the underlying meta‐analytic mean by fitting “right‐truncated meta‐analysis” (RTMA) to the published nonaffirmative estimates. This method essentially imputes the entire underlying distribution of population effects. Second, we propose conducting a standard meta‐analysis of only the nonaffirmative studies (MAN); this estimate is conservative (negatively biased) under weakened assumptions. We provide an R package (phacking) and website ( metabias.io ). Our proposed methods supplement existing methods by assessing the robustness of meta‐analyses to joint SAS and SWS.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Meta-Analysis as TopicPublication BiasAlgorithmsModels, StatisticalHumansResearch DesignData Interpretation, StatisticalSoftwareReproducibility of ResultsComputer Simulation

Stichwörter der Autor:innen

Bayesian analysisdata dredgingfile drawerselective reportingtruncation

Autor:innen und Institutionen

  • Quantitative Sciences Unit, Department of Medicine, Stanford University, Stanford, California, USA.

ORCID-Profile: Maya B Mathur

Förderung

  • NLM NIH HHS
  • NIH HHS
  • NIDDK NIH HHS
  • NCI NIH HHS
  • NCATS NIH HHS
  • National Institutes of Health

Zitieren

APA

Mathur, M. B. (2024). P ‐hacking in meta‐analyses: A formalization and new meta‐analytic methods. Research Synthesis Methods. https://doi.org/10.1002/jrsm.1701

Vancouver

Mathur MB. P ‐hacking in meta‐analyses: A formalization and new meta‐analytic methods. Research Synthesis Methods. 2024. doi:10.1002/jrsm.1701

BibTeX
@article{Mathur2024,
  author = {Mathur, Maya B},
  title = {P ‐hacking in meta‐analyses: A formalization and new meta‐analytic methods},
  journal = {Research Synthesis Methods},
  year = {2024},
  doi = {10.1002/jrsm.1701}
}
Kostenlos starten →