The cross-race effect in automatic facial expression recognition violates measurement invariance
Frontiers in Psychology · 07.12.2023 · 14
DOI: 10.3389/fpsyg.2023.1201145 ↗Kurz gefasst
Fachartikel in der Zeitschrift Frontiers in Psychology, online erschienen am 07.12.2023. Verfasst von Yen-Ting Li und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychology, National Taiwan University, Taipei City, Taiwan. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 53 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Science and Technology Council, National Taiwan University.
Abstract (Originalsprache)
Emotion has been a subject undergoing intensive research in psychology and cognitive neuroscience over several decades. Recently, more and more studies of emotion have adopted automatic rather than manual methods of facial emotion recognition to analyze images or videos of human faces. Compared to manual methods, these computer-vision-based, automatic methods can help objectively and rapidly analyze a large amount of data. These automatic methods have also been validated and believed to be accurate in their judgments. However, these automatic methods often rely on statistical learning models (e.g., deep neural networks), which are intrinsically inductive and thus suffer from problems of induction. Specifically, the models that were trained primarily on Western faces may not generalize well to accurately judge Eastern faces, which can then jeopardize the measurement invariance of emotions in cross-cultural studies. To demonstrate such a possibility, the present study carries out a cross-racial validation of two popular facial emotion recognition systems—FaceReader and DeepFace—using two Western and two Eastern face datasets. Although both systems could achieve overall high accuracies in the judgments of emotion category on the Western datasets, they performed relatively poorly on the Eastern datasets, especially in recognition of negative emotions. While these results caution the use of these automatic methods of emotion recognition on non-Western faces, the results also suggest that the measurements of happiness outputted by these automatic methods are accurate and invariant across races and hence can still be utilized for cross-cultural studies of positive psychology.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Psychology, National Taiwan University, Taipei City, Taiwan.
- Graduate Institute of Brain and Mind Sciences, National Taiwan University, Taipei City, Taiwan.
- Neurobiology and Cognitive Science Center, National Taiwan University, Taipei City, Taiwan.
- Center for Artificial Intelligence and Advanced Robotics, National Taiwan University, Taipei City, Taiwan.
Förderung
- National Science and Technology Council
- National Taiwan University
Zitieren
APA
Li, Y. T., Yeh, S. L., & Huang, T. R. (2023). The cross-race effect in automatic facial expression recognition violates measurement invariance. Frontiers in Psychology, 14. https://doi.org/10.3389/fpsyg.2023.1201145
Vancouver
Li YT, Yeh SL, Huang TR. The cross-race effect in automatic facial expression recognition violates measurement invariance. Frontiers in Psychology. 2023;14. doi:10.3389/fpsyg.2023.1201145
BibTeX
@article{Li2023,
author = {Li, Yen-Ting and Yeh, Su-Ling and Huang, Tsung-Ren},
title = {The cross-race effect in automatic facial expression recognition violates measurement invariance},
journal = {Frontiers in Psychology},
year = {2023},
volume = {14},
doi = {10.3389/fpsyg.2023.1201145}
}
EUVIMED