EUVIMEDEUVIMED entdecken
Validierungsstudie

A new Q‐matrix validation method based on signal detection theory

Jia Li iD, Ping Chen iD

British Journal of Mathematical and Statistical Psychology · 2025

DOI: 10.1111/bmsp.12371 ↗

Kurz gefasst

Validierungsstudie in der Zeitschrift British Journal of Mathematical and Statistical Psychology, 2025. Verfasst von Jia Li und 1 weiteren Autor:innen. Beteiligte Einrichtung: Collaborative Innovation Center of Assessment for Basic Education Quality, Beijing Normal University, Beijing, China. Hauptthemen laut MEDLINE: Signal Detection, Psychological, Psychometrics, Models, Statistical, Cognition. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 47 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Research Program Funds of the Collaborative Innovation Center of Assessment for Basic Education Quality.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The Q‐matrix is a crucial component of cognitive diagnostic theory and an important basis for the research and practical application of cognitive diagnosis. In practice, the Q‐matrix is typically developed by domain experts and may contain some misspecifications, so it needs to be refined using Q‐matrix validation methods. Based on signal detection theory, this paper puts forward a new Q‐matrix validation method (i.e., method) and then conducts a simulation study to compare the new method with existing methods. The results show that when the model is DINA (deterministic inputs, noisy ‘and’ gate), the method outperforms the existing methods under all conditions; under the generalized DINA (G‐DINA) model, the method still has the highest validation rate when the sample size is small, and the item quality is high or the rate of Q‐matrix misspecification is ≥.4. Finally, a sub‐dataset of the PISA 2000 reading assessment is analysed to evaluate the reliability of the method.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Signal Detection, PsychologicalPsychometricsModels, StatisticalCognitionHumansReproducibility of ResultsComputer SimulationAlgorithms

Stichwörter der Autor:innen

Q‐matrix validationcognitive diagnosissignal detection theory

Autor:innen und Institutionen

  • Collaborative Innovation Center of Assessment for Basic Education Quality, Beijing Normal University, Beijing, China.

ORCID-Profile: Jia Li, Ping Chen

Förderung

  • National Natural Science Foundation of China
  • Research Program Funds of the Collaborative Innovation Center of Assessment for Basic Education Quality

Zitieren

APA

Li, J., & Chen, P. (2025). A new Q‐matrix validation method based on signal detection theory. British Journal of Mathematical and Statistical Psychology. https://doi.org/10.1111/bmsp.12371

Vancouver

Li J, Chen P. A new Q‐matrix validation method based on signal detection theory. British Journal of Mathematical and Statistical Psychology. 2025. doi:10.1111/bmsp.12371

BibTeX
@article{Li2025,
  author = {Li, Jia and Chen, Ping},
  title = {A new Q‐matrix validation method based on signal detection theory},
  journal = {British Journal of Mathematical and Statistical Psychology},
  year = {2025},
  doi = {10.1111/bmsp.12371}
}
Kostenlos starten →