EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Type I Error Rates are Not Usually Inflated

Mark Rubin

Journal of Trial and Error · 16.11.2024 · 4 (2)

DOI: 10.36850/4d35-44bd ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Trial and Error, online erschienen am 16.11.2024. Verfasst von Mark Rubin. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 126 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The inflation of Type I error rates is thought to be one of the causes of the replication crisis. Questionable research practices such as p-hacking are thought to inflate Type I error rates above their nominal level, leading to unexpectedly high levels of false positives in the literature and, consequently, unexpectedly low replication rates. In this article, I offer an alternative view. I argue that questionable and other research practices do not usually inflate relevant Type I error rates. I begin by introducing the concept of Type I error rates and distinguishing between statistical errors and theoretical errors. I then illustrate my argument with respect to model misspecification, multiple testing, selective inference, forking paths, exploratory analyses, p-hacking, optional stopping, double dipping, and HARKing. In each case, I demonstrate that relevant Type I error rates are not usually inflated above their nominal level, and in the rare cases that they are, the inflation is easily identified and resolved. I conclude that the replication crisis may be explained, at least in part, by researchers’ misinterpretation of statistical errors and their underestimation of theoretical errors.

Zitieren

APA

Rubin, M. (2024). Type I Error Rates are Not Usually Inflated. Journal of Trial and Error, 4(2). https://doi.org/10.36850/4d35-44bd

Vancouver

Rubin M. Type I Error Rates are Not Usually Inflated. Journal of Trial and Error. 2024;4(2). doi:10.36850/4d35-44bd

BibTeX
@article{Rubin2024,
  author = {Rubin, Mark},
  title = {Type I Error Rates are Not Usually Inflated},
  journal = {Journal of Trial and Error},
  year = {2024},
  volume = {4},
  number = {2},
  doi = {10.36850/4d35-44bd}
}
Kostenlos starten →