EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

The Importance of Understanding False Discoveries and the Accuracy Paradox When Evaluating Quantitative Studies

Kirk Davis, Rodney Maiden

Studies in Social Science Research · 2021

DOI: 10.22158/sssr.v2n2p1 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Studies in Social Science Research, 2021. Verfasst von Kirk Davis und 1 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Although the limitations of null hypothesis significance testing (NHST) are well documented in the psychology literature, the accuracy paradox, which concisely states an important limitation of published research, is never mentioned. The accuracy paradox appears when a test with higher accuracy does a poorer job of correctly classifying a particular outcome than a test with lower accuracy, which suggests that a reliance on accuracy as a metric for a test’s usefulness is not always the best metric. Since accuracy is a function of type I and II error rates, it can be misleading to interpret a study’s results as accurate simply because these errors are minimized. Once a decision has been made regarding statistical significance, type I and II error rates are not directly informative to the reader. Instead, false discovery and false omission rates are more informative when evaluating the results of a study. Given the prevalence of publication bias and small effect sizes in the literature, the possibility of a false discovery is especially important to consider. When false discovery rates are estimated, it is easy to understand why many studies in psychology cannot be replicated.

Zitieren

APA

Davis, K., & Maiden, R. (2021). The Importance of Understanding False Discoveries and the Accuracy Paradox When Evaluating Quantitative Studies. Studies in Social Science Research. https://doi.org/10.22158/sssr.v2n2p1

Vancouver

Davis K, Maiden R. The Importance of Understanding False Discoveries and the Accuracy Paradox When Evaluating Quantitative Studies. Studies in Social Science Research. 2021. doi:10.22158/sssr.v2n2p1

BibTeX
@article{Davis2021,
  author = {Davis, Kirk and Maiden, Rodney},
  title = {The Importance of Understanding False Discoveries and the Accuracy Paradox When Evaluating Quantitative Studies},
  journal = {Studies in Social Science Research},
  year = {2021},
  doi = {10.22158/sssr.v2n2p1}
}
Kostenlos starten →