Domain-Incremental Continual Learning for Mitigating Bias in Facial Expression and Action Unit Recognition
IEEE Transactions on Affective Computing · 01.10.2023 · 14 (4) · 3191-3206
DOI: 10.1109/taffc.2022.3181033 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Affective Computing, erschienen am 01.10.2023. Verfasst von Nikhil Churamani und 2 weiteren Autor:innen. Die Arbeit wurde bisher 55-mal zitiert (Crossref) und nennt 65 Literaturangaben. Gefördert von: Engineering and Physical Sciences Research Council, European Commission.
Abstract (Originalsprache)
As Facial Expression Recognition (FER) systems become integrated into our daily lives, these systems need to prioritise making fair decisions instead of only aiming at higher individual accuracy scores. From surveillance systems, to monitoring the mental and emotional health of individuals, these systems need to balance the accuracy versus fairness trade-off to make decisions that do not unjustly discriminate against specific under-represented demographic groups. Identifying bias as a critical problem in facial analysis systems, different methods have been proposed that aim to mitigate bias both at data and algorithmic levels. In this work, we propose the novel use of Continual Learning (CL), in particular, using Domain-Incremental Learning (Domain-IL) settings, as a potent bias mitigation method to enhance the fairness of Facial Expression Recognition (FER) systems. We compare different non-CL-based and CL-based methods for their performance and fairness scores on expression recognition and Action Unit (AU) detection tasks using two popular benchmarks, the RAF-DB and BP4D datasets, respectively. Our experimental results show that CL-based methods, on average, outperform other popular bias mitigation techniques on both accuracy and fairness metrics.
Förderung
- Engineering and Physical Sciences Research Council
- European Commission
Zitieren
APA
Churamani, N., Kara, O., & Gunes, H. (2023). Domain-Incremental Continual Learning for Mitigating Bias in Facial Expression and Action Unit Recognition. IEEE Transactions on Affective Computing, 14(4), 3191-3206. https://doi.org/10.1109/taffc.2022.3181033
Vancouver
Churamani N, Kara O, Gunes H. Domain-Incremental Continual Learning for Mitigating Bias in Facial Expression and Action Unit Recognition. IEEE Transactions on Affective Computing. 2023;14(4):3191-3206. doi:10.1109/taffc.2022.3181033
BibTeX
@article{Churamani2023,
author = {Churamani, Nikhil and Kara, Ozgur and Gunes, Hatice},
title = {Domain-Incremental Continual Learning for Mitigating Bias in Facial Expression and Action Unit Recognition},
journal = {IEEE Transactions on Affective Computing},
year = {2023},
volume = {14},
number = {4},
pages = {3191--3206},
doi = {10.1109/taffc.2022.3181033}
}
EUVIMED