How Scoring Approaches Impact Estimates of Growth in the Presence of Survey Item Ceiling Effects
Applied Psychological Measurement · 2024-05 · 48 (3) · 147-164
DOI: 10.1177/01466216241238749 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Psychological Measurement, online erschienen am 16.03.2024. Verfasst von Kelly D Edwards und 1 weiteren Autor:innen. Beteiligte Einrichtung: University of Virginia, Charlottesville, VA, USA. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Survey scores are often the basis for understanding how individuals grow psychologically and socio-emotionally. A known problem with many surveys is that the items are all “easy”—that is, individuals tend to use only the top one or two response categories on the Likert scale. Such an issue could be especially problematic, and lead to ceiling effects, when the same survey is administered repeatedly over time. In this study, we conduct simulation and empirical studies to (a) quantify the impact of these ceiling effects on growth estimates when using typical scoring approaches like sum scores and unidimensional item response theory (IRT) models and (b) examine whether approaches to survey design and scoring, including employing various longitudinal multidimensional IRT (MIRT) models, can mitigate any bias in growth estimates. We show that bias is substantial when using typical scoring approaches and that, while lengthening the survey helps somewhat, using a longitudinal MIRT model with plausible values scoring all but alleviates the issue. Results have implications for scoring surveys in growth studies going forward, as well as understanding how Likert item ceiling effects may be contributing to replication failures.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- University of Virginia, Charlottesville, VA, USA.
ORCID-Profile: James Soland
Zitieren
APA
Edwards, K. D., & Soland, J. (2024). How Scoring Approaches Impact Estimates of Growth in the Presence of Survey Item Ceiling Effects. Applied Psychological Measurement, 48(3), 147-164. https://doi.org/10.1177/01466216241238749
Vancouver
Edwards KD, Soland J. How Scoring Approaches Impact Estimates of Growth in the Presence of Survey Item Ceiling Effects. Applied Psychological Measurement. 2024;48(3):147-164. doi:10.1177/01466216241238749
BibTeX
@article{Edwards2024,
author = {Edwards, Kelly D and Soland, James},
title = {How Scoring Approaches Impact Estimates of Growth in the Presence of Survey Item Ceiling Effects},
journal = {Applied Psychological Measurement},
year = {2024},
volume = {48},
number = {3},
pages = {147--164},
doi = {10.1177/01466216241238749}
}
EUVIMED