EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

The cross-race effect in automatic facial expression recognition violates measurement invariance

Yen-Ting Li, Su-Ling Yeh, Tsung-Ren Huang

Frontiers in Psychology · 07.12.2023 · 14

DOI: 10.3389/fpsyg.2023.1201145 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Frontiers in Psychology, online erschienen am 07.12.2023. Verfasst von Yen-Ting Li und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychology, National Taiwan University, Taipei City, Taiwan. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 53 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Science and Technology Council, National Taiwan University.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Emotion has been a subject undergoing intensive research in psychology and cognitive neuroscience over several decades. Recently, more and more studies of emotion have adopted automatic rather than manual methods of facial emotion recognition to analyze images or videos of human faces. Compared to manual methods, these computer-vision-based, automatic methods can help objectively and rapidly analyze a large amount of data. These automatic methods have also been validated and believed to be accurate in their judgments. However, these automatic methods often rely on statistical learning models (e.g., deep neural networks), which are intrinsically inductive and thus suffer from problems of induction. Specifically, the models that were trained primarily on Western faces may not generalize well to accurately judge Eastern faces, which can then jeopardize the measurement invariance of emotions in cross-cultural studies. To demonstrate such a possibility, the present study carries out a cross-racial validation of two popular facial emotion recognition systems—FaceReader and DeepFace—using two Western and two Eastern face datasets. Although both systems could achieve overall high accuracies in the judgments of emotion category on the Western datasets, they performed relatively poorly on the Eastern datasets, especially in recognition of negative emotions. While these results caution the use of these automatic methods of emotion recognition on non-Western faces, the results also suggest that the measurements of happiness outputted by these automatic methods are accurate and invariant across races and hence can still be utilized for cross-cultural studies of positive psychology.

Schlagwörter

Stichwörter der Autor:innen

cross-cultural psychologycross-race effectemotion recognitionfacial expressioninductive biasmeasurement invariancevalidation

Autor:innen und Institutionen

  • Department of Psychology, National Taiwan University, Taipei City, Taiwan.
  • Graduate Institute of Brain and Mind Sciences, National Taiwan University, Taipei City, Taiwan.
  • Neurobiology and Cognitive Science Center, National Taiwan University, Taipei City, Taiwan.
  • Center for Artificial Intelligence and Advanced Robotics, National Taiwan University, Taipei City, Taiwan.

Förderung

  • National Science and Technology Council
  • National Taiwan University

Zitieren

APA

Li, Y. T., Yeh, S. L., & Huang, T. R. (2023). The cross-race effect in automatic facial expression recognition violates measurement invariance. Frontiers in Psychology, 14. https://doi.org/10.3389/fpsyg.2023.1201145

Vancouver

Li YT, Yeh SL, Huang TR. The cross-race effect in automatic facial expression recognition violates measurement invariance. Frontiers in Psychology. 2023;14. doi:10.3389/fpsyg.2023.1201145

BibTeX
@article{Li2023,
  author = {Li, Yen-Ting and Yeh, Su-Ling and Huang, Tsung-Ren},
  title = {The cross-race effect in automatic facial expression recognition violates measurement invariance},
  journal = {Frontiers in Psychology},
  year = {2023},
  volume = {14},
  doi = {10.3389/fpsyg.2023.1201145}
}
Kostenlos starten →