Refining effect size measures and classification for differential item functioning: Toward unified guidelines across methods
British Journal of Mathematical and Statistical Psychology · 10.07.2026
DOI: 10.1111/bmsp.70060 ↗Kurz gefasst
Leitlinie in der Zeitschrift British Journal of Mathematical and Statistical Psychology, online erschienen am 10.07.2026. Verfasst von Michaela Cichrová und 2 weiteren Autor:innen. Beteiligte Einrichtung: Institute of Computer Science of the Czech Academy of Sciences, Prague, Czech Republic. Die Arbeit nennt 56 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministerstvo Školství, Mládeže a Tělovýchovy, Univerzita Karlova v Praze, Grantová Agentura České Republiky.
Abstract (Originalsprache)
Differential Item Functioning (DIF) analysis is used to identify potentially biased items in multi‐item measurements. In addition to testing the statistical significance, it is essential to evaluate the practical significance of DIF through effect size measures. We review existing DIF effect size measures and cut‐off values used to classify the effect size magnitudes for the Mantel‐Haenszel test, SIBTEST, and logistic regression for binary items, and introduce a refinement of area‐based effect size measures. A simulation study is conducted to investigate the properties of these effect size measures and existing classification guidelines, and to assess their comparative performance. The results indicate that some commonly used effect size measures exhibit undesirable properties, including inconsistent classifications, systematic underestimation of the magnitude of the underlying DIF, and strong dependence on design factors. To address these issues, we introduce usage restrictions for some effect size measures, revised cut‐off values that unify results across different methods, and propose new cut‐off values for area‐based effect size measures. The methods are demonstrated using two real data examples. Implementation is provided in the R software.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Institute of Computer Science of the Czech Academy of Sciences, Prague, Czech Republic.
- Department of Probability and Mathematical Statistics, Faculty of Mathematics and Physics, Charles University, Prague, Czech Republic.
- Faculty of Education, Institute for Research and Development in Education, Charles University, Prague, Czech Republic.
ORCID-Profile: Michaela Cichrová, Adéla Hladká, Patrícia Martinková
Förderung
- Ministerstvo Školství, Mládeže a Tělovýchovy
- Univerzita Karlova v Praze
- Grantová Agentura České Republiky
Zitieren
APA
Cichrová, M., Hladká, A., & Martinková, P. (2026). Refining effect size measures and classification for differential item functioning: Toward unified guidelines across methods. British Journal of Mathematical and Statistical Psychology. https://doi.org/10.1111/bmsp.70060
Vancouver
Cichrová M, Hladká A, Martinková P. Refining effect size measures and classification for differential item functioning: Toward unified guidelines across methods. British Journal of Mathematical and Statistical Psychology. 2026. doi:10.1111/bmsp.70060
BibTeX
@article{Cichrov2026,
author = {Cichrová, Michaela and Hladká, Adéla and Martinková, Patrícia},
title = {Refining effect size measures and classification for differential item functioning: Toward unified guidelines across methods},
journal = {British Journal of Mathematical and Statistical Psychology},
year = {2026},
doi = {10.1111/bmsp.70060}
}
EUVIMED