Investigating Algorithmic Bias in Affect Detectors with Constructed Categories of Student Identity
International Conference on Computers in Education · 01.12.2025
DOI: 10.58459/icce.2025.5915 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Conference on Computers in Education, online erschienen am 01.12.2025. Verfasst von Nidhi Nasiar und 7 weiteren Autor:innen.
Abstract (Originalsprache)
Algorithmic bias research often evaluates models in terms of traditional demographic categories (e.g., U.S. Census), but these categories may not capture nuanced, context-dependent identities relevant to learning. This study evaluates four affect detectors (boredom, confusion, engaged concentration, and frustration) developed for an adaptive math learning system. Metrics for algorithmic fairness (AUC, weighted F1, MADD) show subgroup differences across several categories that emerged from a free-response social identity survey (Twenty Statements Test; TST), including both those that mirror demographic categories (i.e., race and gender) as well as novel categories (i.e., Learner Identity, Interpersonal Style, and Sense of Competence). For demographic categories, the confusion detector performs better for boys than for girls and underperforms for West African students. Among novel categories, biases are found related to learner identity (boredom, engaged concentration, and confusion) and interpersonal style (confusion), but not for sense of competence. Results highlight the importance of using contextually grounded social identities to evaluate bias.
Zitieren
APA
Nasiar, N., Belitz, C., Lee, H., Stinar, F., Baker, R. S., Ocumpaugh, J., Fancsali, S., & Ritter, S. (2025). Investigating Algorithmic Bias in Affect Detectors with Constructed Categories of Student Identity. International Conference on Computers in Education. https://doi.org/10.58459/icce.2025.5915
Vancouver
Nasiar N, Belitz C, Lee H, Stinar F, Baker RS, Ocumpaugh J, et al. Investigating Algorithmic Bias in Affect Detectors with Constructed Categories of Student Identity. International Conference on Computers in Education. 2025. doi:10.58459/icce.2025.5915
BibTeX
@article{Nasiar2025,
author = {Nasiar, Nidhi and Belitz, Clara and Lee, Haejin and Stinar, Frank and Baker, Ryan S. and Ocumpaugh, Jaclyn and Fancsali, Stephen and Ritter, Steve},
title = {Investigating Algorithmic Bias in Affect Detectors with Constructed Categories of Student Identity},
journal = {International Conference on Computers in Education},
year = {2025},
doi = {10.58459/icce.2025.5915}
}
EUVIMED