condfair: An R Package for Ability-Conditioned Fairness and Explanation Diagnostics in Automated Scoring
Applied Psychological Measurement · 24.08.2026
DOI: 10.1177/01466216261484166 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Psychological Measurement, online erschienen am 24.08.2026. Verfasst von Tri Zahra Ningsih und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Educational Research and Evaluation, Graduate School, Universitas Negeri Yogyakarta, Yogyakarta, Indonesia. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 7 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Fairness in automated scoring is typically evaluated with a single global statistic contrasting a focal and reference group—an approach that can either mask a disparity that changes sign across the ability range, or overstate one by conflating it with genuine ability differences between groups (impact). We introduce condfair, an R package that adapts differential item functioning (DIF) logic to automated scoring: it estimates a conditional disparity function across ability levels, tests it with a wild-bootstrap omnibus procedure, decomposes bias into uniform and non-uniform components, and identifies candidate feature-level sources of a detected disparity via conditional SHAP disparity testing. Using the PERSUADE 2.0 essay corpus, we show a global measure can conceal a large, ability-concentrated gender disparity (marginal gap = 0.003; peak conditional disparity = 0.276, p = .001) while overstating an English Language Learner disparity by conflating it with impact (marginal gap = 0.280; conditional bias = 0.045).
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Educational Research and Evaluation, Graduate School, Universitas Negeri Yogyakarta, Yogyakarta, Indonesia.
- Department of Sports Education, Faculty of Sports and Health Sciences, Universitas Negeri Yogyakarta, Yogyakarta, Indonesia.
ORCID-Profile: Tri Zahra Ningsih
Zitieren
APA
Ningsih, T. Z., Aman, A., & Nasrulloh, A. (2026). condfair: An R Package for Ability-Conditioned Fairness and Explanation Diagnostics in Automated Scoring. Applied Psychological Measurement. https://doi.org/10.1177/01466216261484166
Vancouver
Ningsih TZ, Aman A, Nasrulloh A. condfair: An R Package for Ability-Conditioned Fairness and Explanation Diagnostics in Automated Scoring. Applied Psychological Measurement. 2026. doi:10.1177/01466216261484166
BibTeX
@article{Ningsih2026,
author = {Ningsih, Tri Zahra and Aman, Aman and Nasrulloh, Ahmad},
title = {condfair: An R Package for Ability-Conditioned Fairness and Explanation Diagnostics in Automated Scoring},
journal = {Applied Psychological Measurement},
year = {2026},
doi = {10.1177/01466216261484166}
}
EUVIMED