EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Not normal: a simulation study comparing effect sizes for skewed psychological data

Ambra Perugini, Giulia Calignano, Massimiliano Pastore

Frontiers in Psychology · 21.04.2026 · 17

DOI: 10.3389/fpsyg.2026.1771029 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Frontiers in Psychology, online erschienen am 21.04.2026. Verfasst von Ambra Perugini und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Developmental and Social Psychology, University of Padua, Padua, Italy. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 22 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Effect sizes are widely used in psychological science, but with a focus solely on mean differences. This study compares three mean-based indices: Cohen's d , the Common Language Effect Size (CLES), the parametric overlap coefficient derived from d (η p ), to the non-parametric Overlapping Index (η), which focuses on the entire distributional differences. Using skew-normal distributions to generate controlled scenarios of violations of normality and variance homogeneity, and symmetry, we systematically manipulated mean differences, variance ratios, skewness, and sample size to evaluate each index in terms of Relative Mean Bias, Normalized Root Mean Square Error, and 95% Coverage. Cohen's d , CLES, and η p showed near-perfect descriptive correlations; however, their performance differed substantially. Cohen's d consistently exhibited low bias, high precision, and accurate coverage across all scenarios, whereas CLES and η p showed substantial bias and low coverage, particularly under skewness and heteroscedasticity. The non-parametric index η remained unbiased under shape differences and variance heterogeneity but performed less reliably when the populations truly overlapped. The results indicated that effect-size indices derived from d are not interchangeable, and that high empirical correlations do not guarantee same precision. Cohen's d remains the most robust estimator of a location difference, whereas, η provides a more complete view of the entire distribution. Here, we argue that researchers should select effect sizes based on their statistical properties and propose a shift toward interpreting effects in light of the full distribution, rather than through mean-based conventions.

Schlagwörter

Stichwörter der Autor:innen

Cohen's ddata simulationeffect sizenon-normal dataoverlapping index

Autor:innen und Institutionen

  • Department of Developmental and Social Psychology, University of Padua, Padua, Italy.

Zitieren

APA

Perugini, A., Calignano, G., & Pastore, M. (2026). Not normal: a simulation study comparing effect sizes for skewed psychological data. Frontiers in Psychology, 17. https://doi.org/10.3389/fpsyg.2026.1771029

Vancouver

Perugini A, Calignano G, Pastore M. Not normal: a simulation study comparing effect sizes for skewed psychological data. Frontiers in Psychology. 2026;17. doi:10.3389/fpsyg.2026.1771029

BibTeX
@article{Perugini2026,
  author = {Perugini, Ambra and Calignano, Giulia and Pastore, Massimiliano},
  title = {Not normal: a simulation study comparing effect sizes for skewed psychological data},
  journal = {Frontiers in Psychology},
  year = {2026},
  volume = {17},
  doi = {10.3389/fpsyg.2026.1771029}
}
Kostenlos starten →