Item Orientation as a Confound in Epistemology Scales
AERA Open · 2026-01 · 12
DOI: 10.1177/23328584261457135 ↗Kurz gefasst
Fachartikel in der Zeitschrift AERA Open, online erschienen am 18.06.2026. Verfasst von Jacob Steiss und 3 weiteren Autor:innen. Die Arbeit nennt 78 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: Institute of Education Sciences.
Abstract (Originalsprache)
Item orientation—whether agreement with a survey item indicates higher (positive) or lower (negative) standing on a construct—can influence the factor structure of psychological assessments in education research. This study investigated how item orientation affected inferences about the factor structure of students’ epistemology in history because previous studies consistently measured factors of epistemology with uniformly oriented items within factors and polarized item orientation across factors. We administered a survey comprised of positively and negatively oriented items for three previously hypothesized dimensions of student epistemology—complex, tentative, and integration beliefs. We used confirmatory factor analysis to examine how different approaches to handling item orientation affected conclusions about the factor structure of epistemology. First, we replicated the factor structure of epistemology in prior research using a subset of uniformly oriented items within factors and polarized item orientation across factors, finding similar fit and small inter-factor associations as seen in previous research. Second, we introduced items of mixed orientation to measure each factor and found that model fit became poor. Third, we simultaneously modeled substantive and method factors, resulting in improved model fit. The method factor explained more variance than substantive factors, indicating item orientation was a significant confound. When controlling for a method effect (i.e., item orientation), associations among epistemology factors were large and positive, suggesting that previous findings of roughly orthogonal epistemology factors may result from offsetting negatively associated method factors and positively associated substantive factors.
Förderung
- Institute of Education Sciences
Zitieren
APA
Steiss, J., Bailey, D., Tate, T., & Graham, S. (2026). Item Orientation as a Confound in Epistemology Scales. AERA Open, 12. https://doi.org/10.1177/23328584261457135
Vancouver
Steiss J, Bailey D, Tate T, Graham S. Item Orientation as a Confound in Epistemology Scales. AERA Open. 2026;12. doi:10.1177/23328584261457135
BibTeX
@article{Steiss2026,
author = {Steiss, Jacob and Bailey, Drew and Tate, Tamara and Graham, Steve},
title = {Item Orientation as a Confound in Epistemology Scales},
journal = {AERA Open},
year = {2026},
volume = {12},
doi = {10.1177/23328584261457135}
}
EUVIMED