EUVIMEDEUVIMED entdecken
Crossref

Balancing fit and parsimony to improve Q‐matrix validation

Pablo Nájera iD, Miguel A Sorrel iD, Jimmy de la Torre, Francisco José Abad iD

British Journal of Mathematical and Statistical Psychology · 2021-07 · 74 (S1) · 110-130

DOI: 10.1111/bmsp.12228 ↗

Kurz gefasst

Fachartikel in der Zeitschrift British Journal of Mathematical and Statistical Psychology, online erschienen am 24.11.2020. Verfasst von Pablo Nájera und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Social Psychology and Methodology, Autonomous University of Madrid, Spain. Hauptthemen laut MEDLINE: Models, Statistical, Research Design. Die Arbeit wurde bisher 29-mal zitiert (Crossref) und nennt 28 Literaturangaben. Gefördert von: European Social Fund.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The Q‐matrix identifies the subset of attributes measured by each item in the cognitive diagnosis modelling framework. Usually constructed by domain experts, the Q‐matrix might contain some misspecifications, disrupting classification accuracy. Empirical Q‐matrix validation methods such as the general discrimination index (GDI) and Wald have shown promising results in addressing this problem. However, a cut‐off point is used in both methods, which might be suboptimal. To address this limitation, the Hull method is proposed and evaluated in the present study. This method aims to find the optimal balance between fit and parsimony, and it is flexible enough to be used either with a measure of item discrimination (the proportion of variance accounted for , PVAF) or a coefficient of determination (pseudo‐ R 2 ). Results from a simulation study showed that the Hull method consistently showed the best performance and shortest computation time, especially when used with the PVAF. The Wald method also performed very well overall, while the GDI method obtained poor results when the number of attributes was high. The absence of a cut‐off point provides greater flexibility to the Hull method, and it places it as a comprehensive solution to the Q‐matrix specification problem in applied settings. This proposal is illustrated using real data.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Models, StatisticalResearch DesignComputer SimulationPsychometrics

Stichwörter der Autor:innen

CDMG-DINAHull methodPVAFQ-matrixR-squaredValidation

Autor:innen und Institutionen

  • Department of Social Psychology and Methodology, Autonomous University of Madrid, Spain.
  • Faculty of Education, The University of Hong Kong, Pokfulam, Hong Kong.

ORCID-Profile: Pablo Nájera, Miguel A Sorrel, Francisco José Abad

Förderung

  • European Social Fund

Zitieren

APA

Nájera, P., Sorrel, M. A., de la Torre, J., & Abad, F. J. (2021). Balancing fit and parsimony to improve Q‐matrix validation. British Journal of Mathematical and Statistical Psychology, 74(S1), 110-130. https://doi.org/10.1111/bmsp.12228

Vancouver

Nájera P, Sorrel MA, de la Torre J, Abad FJ. Balancing fit and parsimony to improve Q‐matrix validation. British Journal of Mathematical and Statistical Psychology. 2021;74(S1):110-130. doi:10.1111/bmsp.12228

BibTeX
@article{Njera2021,
  author = {Nájera, Pablo and Sorrel, Miguel A and de la Torre, Jimmy and Abad, Francisco José},
  title = {Balancing fit and parsimony to improve Q‐matrix validation},
  journal = {British Journal of Mathematical and Statistical Psychology},
  year = {2021},
  volume = {74},
  number = {S1},
  pages = {110--130},
  doi = {10.1111/bmsp.12228}
}
Kostenlos starten →