EUVIMEDEUVIMED entdecken
Open Access

condfair: An R Package for Ability-Conditioned Fairness and Explanation Diagnostics in Automated Scoring

Tri Zahra Ningsih iD, Aman Aman, Ahmad Nasrulloh

Applied Psychological Measurement · 24.08.2026

DOI: 10.1177/01466216261484166 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Psychological Measurement, online erschienen am 24.08.2026. Verfasst von Tri Zahra Ningsih und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Educational Research and Evaluation, Graduate School, Universitas Negeri Yogyakarta, Yogyakarta, Indonesia. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 7 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Fairness in automated scoring is typically evaluated with a single global statistic contrasting a focal and reference group—an approach that can either mask a disparity that changes sign across the ability range, or overstate one by conflating it with genuine ability differences between groups (impact). We introduce condfair, an R package that adapts differential item functioning (DIF) logic to automated scoring: it estimates a conditional disparity function across ability levels, tests it with a wild-bootstrap omnibus procedure, decomposes bias into uniform and non-uniform components, and identifies candidate feature-level sources of a detected disparity via conditional SHAP disparity testing. Using the PERSUADE 2.0 essay corpus, we show a global measure can conceal a large, ability-concentrated gender disparity (marginal gap = 0.003; peak conditional disparity = 0.276, p = .001) while overstating an English Language Learner disparity by conflating it with impact (marginal gap = 0.280; conditional bias = 0.045).

Schlagwörter

Stichwörter der Autor:innen

R packageSHAPautomated scoringconditional biasdifferential item functioningfairnessmachine learning

Autor:innen und Institutionen

  • Department of Educational Research and Evaluation, Graduate School, Universitas Negeri Yogyakarta, Yogyakarta, Indonesia.
  • Department of Sports Education, Faculty of Sports and Health Sciences, Universitas Negeri Yogyakarta, Yogyakarta, Indonesia.

ORCID-Profile: Tri Zahra Ningsih

Zitieren

APA

Ningsih, T. Z., Aman, A., & Nasrulloh, A. (2026). condfair: An R Package for Ability-Conditioned Fairness and Explanation Diagnostics in Automated Scoring. Applied Psychological Measurement. https://doi.org/10.1177/01466216261484166

Vancouver

Ningsih TZ, Aman A, Nasrulloh A. condfair: An R Package for Ability-Conditioned Fairness and Explanation Diagnostics in Automated Scoring. Applied Psychological Measurement. 2026. doi:10.1177/01466216261484166

BibTeX
@article{Ningsih2026,
  author = {Ningsih, Tri Zahra and Aman, Aman and Nasrulloh, Ahmad},
  title = {condfair: An R Package for Ability-Conditioned Fairness and Explanation Diagnostics in Automated Scoring},
  journal = {Applied Psychological Measurement},
  year = {2026},
  doi = {10.1177/01466216261484166}
}
Kostenlos starten →