Person Misfit and Person Reliability in Rating Scale Measures: The Role of Response Styles
Measurement: Interdisciplinary Research and Perspectives · 03.07.2023 · 21 (3) · 167-180
DOI: 10.1080/15366367.2022.2114243 ↗Kurz gefasst
Fachartikel in der Zeitschrift Measurement: Interdisciplinary Research and Perspectives, online erschienen am 01.08.2023. Verfasst von Tongtong Zou und 1 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 47 Literaturangaben.
Abstract (Originalsprache)
Person misfit and person reliability indices in item response theory (IRT) can play an important role in evaluating the validity of a test or survey instrument at the respondent level. Prior empirical comparisons of these indices have been applied to binary item response data and suggest that the two types of indices return very similar results. In this paper, however, we demonstrate an important applied distinction between these methods when applied to polytomously-scored rating scale items, namely their varying sensitivities to response style tendencies. Using several empirical datasets, we illustrate settings in which these indices are in one case highly correlated and in two other cases weakly correlated. In the datasets showing a weak correlation between indices, the primary distinction appears due to the effects of response style behavior, whereby respondents whose response styles are less common (e.g. a disproportionate selection of the midpoint response) are found to misfit using Drasgow et al’s person misfit index, but often show high levels of reliability from a person reliability perspective; just the opposite frequently occurs for respondents that over-select the rating scale extremes. It is suggested that person misfit reporting should be supplemented with an evaluation of person reliability to best understand the validity of measurement at the respondent level when using IRT models with rating scale measures.
Zitieren
APA
Zou, T., & Bolt, D. M. (2023). Person Misfit and Person Reliability in Rating Scale Measures: The Role of Response Styles. Measurement: Interdisciplinary Research and Perspectives, 21(3), 167-180. https://doi.org/10.1080/15366367.2022.2114243
Vancouver
Zou T, Bolt DM. Person Misfit and Person Reliability in Rating Scale Measures: The Role of Response Styles. Measurement: Interdisciplinary Research and Perspectives. 2023;21(3):167-180. doi:10.1080/15366367.2022.2114243
BibTeX
@article{Zou2023,
author = {Zou, Tongtong and Bolt, Daniel M.},
title = {Person Misfit and Person Reliability in Rating Scale Measures: The Role of Response Styles},
journal = {Measurement: Interdisciplinary Research and Perspectives},
year = {2023},
volume = {21},
number = {3},
pages = {167--180},
doi = {10.1080/15366367.2022.2114243}
}
EUVIMED