EUVIMEDOpdag EUVIMED
Open access · CC BY 4.0

Researcher degrees of freedom in phonetic research

Timo B. Roettger

Laboratory Phonology: Journal of the Association for Laboratory Phonology · 2019-01-04 · 10 (1)

DOI: 10.5334/labphon.147 ↗

At a glance

Journal article in Laboratory Phonology: Journal of the Association for Laboratory Phonology, published on 2019-01-04. Written by Timo B. Roettger. Cited 49 times so far (Crossref); 101 references. The full text is freely available (open access, CC BY 4.0).

AbstractBibliografiske oplysningerCiteRelated studies

Abstract (original language)

The results of published research critically depend on methodological decisions that have been made during data analysis. These so-called ‘researcher degrees of freedom’ (Simmons, Nelson, & Simonsohn, 2011) can affect the results and the conclusions researchers draw from it. It is argued that phonetic research faces a large number of researcher degrees of freedom due to its scientific object—speech—being inherently multidimensional and exhibiting complex interactions between multiple covariates. A Type-I error simulation is presented that demonstrates the severe inflation of false positives when exploring researcher degrees of freedom. It is argued that combined with common cognitive fallacies, exploitation of researcher degrees of freedom introduces strong bias and poses a serious challenge to quantitative phonetics as an empirical science. This paper discusses potential remedies for this problem including adjusting the threshold for significance; drawing a clear line between confirmatory and exploratory analyses via preregistration; open, honest, and transparent practices in communicating data analytical decisions; and direct replications.

Cite

APA

Roettger, T. B. (2019). Researcher degrees of freedom in phonetic research. Laboratory Phonology: Journal of the Association for Laboratory Phonology, 10(1). https://doi.org/10.5334/labphon.147

Vancouver

Roettger TB. Researcher degrees of freedom in phonetic research. Laboratory Phonology: Journal of the Association for Laboratory Phonology. 2019;10(1). doi:10.5334/labphon.147

BibTeX
@article{Roettger2019,
  author = {Roettger, Timo B.},
  title = {Researcher degrees of freedom in phonetic research},
  journal = {Laboratory Phonology: Journal of the Association for Laboratory Phonology},
  year = {2019},
  volume = {10},
  number = {1},
  doi = {10.5334/labphon.147}
}
Start for free →