Are we comparing apples or squared apples? The proportion of explained variance exaggerates differences between effects
OpenPsych · 2021
DOI: 10.26775/op.2021.06.15 ↗Kurz gefasst
Fachartikel in der Zeitschrift OpenPsych, 2021. Verfasst von Marco Del Giudice. Die Arbeit wurde bisher 6-mal zitiert (Crossref).
Abstract (Originalsprache)
In this brief note, I wish to bring attention to a problem that has been discussed many times before, but whose implications are still not widely appreciated. As a result, many researchers (present author included) keep making distorted inferences about the relative size and importance of certain effects, by directly comparing the proportions of variance they account for. Using the proportion of explained variance as an index of effect size does not just distort the interpretation of individual effects, but also exaggerates the differences between effects, which may lead to strikingly incorrect judgements of relative importance. Luckily, a meaningful and interpretable “effect ratio” can be easily calculated as the square root of the ratio between proportions of explained variance. In several real-world examples, effect ratios tell a different story than variance components, and might prompt one to rethink the interpretation of certain canonical results (e.g., regarding the role of the shared environment in the development of psychological traits). This simple but consequential point should be understood more widely; with no pretense of originality, I hope that this note will contribute to raise awareness and prevent fallacious interpretations of research findings.
Zitieren
APA
Giudice, M. D. (2021). Are we comparing apples or squared apples? The proportion of explained variance exaggerates differences between effects. OpenPsych. https://doi.org/10.26775/op.2021.06.15
Vancouver
Giudice MD. Are we comparing apples or squared apples? The proportion of explained variance exaggerates differences between effects. OpenPsych. 2021. doi:10.26775/op.2021.06.15
BibTeX
@article{Giudice2021,
author = {Giudice, Marco Del},
title = {Are we comparing apples or squared apples? The proportion of explained variance exaggerates differences between effects},
journal = {OpenPsych},
year = {2021},
doi = {10.26775/op.2021.06.15}
}
EUVIMED