Balancing fit and parsimony to improve Q‐matrix validation
British Journal of Mathematical and Statistical Psychology · 2021-07 · 74 (S1) · 110-130
DOI: 10.1111/bmsp.12228 ↗Kurz gefasst
Fachartikel in der Zeitschrift British Journal of Mathematical and Statistical Psychology, online erschienen am 24.11.2020. Verfasst von Pablo Nájera und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Social Psychology and Methodology, Autonomous University of Madrid, Spain. Hauptthemen laut MEDLINE: Models, Statistical, Research Design. Die Arbeit wurde bisher 29-mal zitiert (Crossref) und nennt 28 Literaturangaben. Gefördert von: European Social Fund.
Abstract (Originalsprache)
The Q‐matrix identifies the subset of attributes measured by each item in the cognitive diagnosis modelling framework. Usually constructed by domain experts, the Q‐matrix might contain some misspecifications, disrupting classification accuracy. Empirical Q‐matrix validation methods such as the general discrimination index (GDI) and Wald have shown promising results in addressing this problem. However, a cut‐off point is used in both methods, which might be suboptimal. To address this limitation, the Hull method is proposed and evaluated in the present study. This method aims to find the optimal balance between fit and parsimony, and it is flexible enough to be used either with a measure of item discrimination (the proportion of variance accounted for , PVAF) or a coefficient of determination (pseudo‐ R 2 ). Results from a simulation study showed that the Hull method consistently showed the best performance and shortest computation time, especially when used with the PVAF. The Wald method also performed very well overall, while the GDI method obtained poor results when the number of attributes was high. The absence of a cut‐off point provides greater flexibility to the Hull method, and it places it as a comprehensive solution to the Q‐matrix specification problem in applied settings. This proposal is illustrated using real data.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Social Psychology and Methodology, Autonomous University of Madrid, Spain.
- Faculty of Education, The University of Hong Kong, Pokfulam, Hong Kong.
ORCID-Profile: Pablo Nájera, Miguel A Sorrel, Francisco José Abad
Förderung
- European Social Fund
Zitieren
APA
Nájera, P., Sorrel, M. A., de la Torre, J., & Abad, F. J. (2021). Balancing fit and parsimony to improve Q‐matrix validation. British Journal of Mathematical and Statistical Psychology, 74(S1), 110-130. https://doi.org/10.1111/bmsp.12228
Vancouver
Nájera P, Sorrel MA, de la Torre J, Abad FJ. Balancing fit and parsimony to improve Q‐matrix validation. British Journal of Mathematical and Statistical Psychology. 2021;74(S1):110-130. doi:10.1111/bmsp.12228
BibTeX
@article{Njera2021,
author = {Nájera, Pablo and Sorrel, Miguel A and de la Torre, Jimmy and Abad, Francisco José},
title = {Balancing fit and parsimony to improve Q‐matrix validation},
journal = {British Journal of Mathematical and Statistical Psychology},
year = {2021},
volume = {74},
number = {S1},
pages = {110--130},
doi = {10.1111/bmsp.12228}
}
EUVIMED