An examination of the openpsychometrics.org vocabulary test
OpenPsych · 2021
DOI: 10.26775/op.2021.07.05 ↗Kurz gefasst
Fachartikel in der Zeitschrift OpenPsych, 2021. Verfasst von Emil O. W. Kirkegaard.
Abstract (Originalsprache)
We examined data from the popular free online 45-item “Vocabulary IQ Test” from https://openpsychometrics.org/tests/VIQT/ . We used data from native English speakers (n = 9,278). Item response theory analysis (IRT) showed that most items had substantial g-loadings (mean = .59, sd = .22), but that some were problematic (4 items being lower than .25). Nevertheless, we find that using the site’s scoring rules (that include penalty for incorrect answers) give results that correlate very strongly (r = .92) with IRT-derived scores. This is also true when using nominal IRT. The empirical reliability was estimated to be about .90. Median test completion time was 9 minutes (median absolute deviation = 3.5) and was mostly unrelated to the score obtained (r = -.02). The test scores correlated well with self-reported criterion variables educational attainment (r = .44) and age (r = .40). To examine the test for measurement bias, we employed both Jensen’s method and differential item functioning (DIF) testing. With Jensen’s method, we see strong associations with education (r = .89) and age (r = .88), and less so for sex (r = .32). With differential item functioning, we only tested the sex difference for bias. We find that some items display moderate biases in favor of one sex (13 items had pbonferroni
Zitieren
APA
Kirkegaard, E. O. W. (2021). An examination of the openpsychometrics.org vocabulary test. OpenPsych. https://doi.org/10.26775/op.2021.07.05
Vancouver
Kirkegaard EOW. An examination of the openpsychometrics.org vocabulary test. OpenPsych. 2021. doi:10.26775/op.2021.07.05
BibTeX
@article{Kirkegaard2021,
author = {Kirkegaard, Emil O. W.},
title = {An examination of the openpsychometrics.org vocabulary test},
journal = {OpenPsych},
year = {2021},
doi = {10.26775/op.2021.07.05}
}
EUVIMED