A new Q‐matrix validation method based on signal detection theory
British Journal of Mathematical and Statistical Psychology · 2025
DOI: 10.1111/bmsp.12371 ↗Kurz gefasst
Validierungsstudie in der Zeitschrift British Journal of Mathematical and Statistical Psychology, 2025. Verfasst von Jia Li und 1 weiteren Autor:innen. Beteiligte Einrichtung: Collaborative Innovation Center of Assessment for Basic Education Quality, Beijing Normal University, Beijing, China. Hauptthemen laut MEDLINE: Signal Detection, Psychological, Psychometrics, Models, Statistical, Cognition. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 47 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Research Program Funds of the Collaborative Innovation Center of Assessment for Basic Education Quality.
Abstract (Originalsprache)
The Q‐matrix is a crucial component of cognitive diagnostic theory and an important basis for the research and practical application of cognitive diagnosis. In practice, the Q‐matrix is typically developed by domain experts and may contain some misspecifications, so it needs to be refined using Q‐matrix validation methods. Based on signal detection theory, this paper puts forward a new Q‐matrix validation method (i.e., method) and then conducts a simulation study to compare the new method with existing methods. The results show that when the model is DINA (deterministic inputs, noisy ‘and’ gate), the method outperforms the existing methods under all conditions; under the generalized DINA (G‐DINA) model, the method still has the highest validation rate when the sample size is small, and the item quality is high or the rate of Q‐matrix misspecification is ≥.4. Finally, a sub‐dataset of the PISA 2000 reading assessment is analysed to evaluate the reliability of the method.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Collaborative Innovation Center of Assessment for Basic Education Quality, Beijing Normal University, Beijing, China.
Förderung
- National Natural Science Foundation of China
- Research Program Funds of the Collaborative Innovation Center of Assessment for Basic Education Quality
Zitieren
APA
Li, J., & Chen, P. (2025). A new Q‐matrix validation method based on signal detection theory. British Journal of Mathematical and Statistical Psychology. https://doi.org/10.1111/bmsp.12371
Vancouver
Li J, Chen P. A new Q‐matrix validation method based on signal detection theory. British Journal of Mathematical and Statistical Psychology. 2025. doi:10.1111/bmsp.12371
BibTeX
@article{Li2025,
author = {Li, Jia and Chen, Ping},
title = {A new Q‐matrix validation method based on signal detection theory},
journal = {British Journal of Mathematical and Statistical Psychology},
year = {2025},
doi = {10.1111/bmsp.12371}
}
EUVIMED