EUVIMEDObjevte EUVIMED
Open access · CC BY 4.0

Not in My Face: Challenges and Ethical Considerations in Automatic Face Emotion Recognition Technology

Martina Mattioli, Federico Cabitza

Machine Learning and Knowledge Extraction · 2024-09-30 · 6 (4) · 2201-2231

DOI: 10.3390/make6040109 ↗

At a glance

Journal article in Machine Learning and Knowledge Extraction, published online on 2024-09-30. Written by Martina Mattioli and 1 co-authors. Cited 37 times so far (Crossref); 145 references. The full text is freely available (open access, CC BY 4.0).

AbstraktBibliografické údajeCiteRelated studies

Abstract (original language)

Automatic Face Emotion Recognition (FER) technologies have become widespread in various applications, including surveillance, human–computer interaction, and health care. However, these systems are built on the basis of controversial psychological models that claim facial expressions are universally linked to specific emotions—a concept often referred to as the “universality hypothesis”. Recent research highlights significant variability in how emotions are expressed and perceived across different cultures and contexts. This paper identifies a gap in evaluating the reliability and ethical implications of these systems, given their potential biases and privacy concerns. Here, we report a comprehensive review of the current debates surrounding FER, with a focus on cultural and social biases, the ethical implications of their application, and their technical reliability. Moreover, we propose a classification that organizes these perspectives into a three-part taxonomy. Key findings show that FER systems are built with limited datasets with potential annotation biases, in addition to lacking cultural context and exhibiting significant unreliability, with misclassification rates influenced by race and background. In some cases, the systems’ errors lead to significant ethical concerns, particularly in sensitive settings such as law enforcement and surveillance. This study calls for more rigorous evaluation frameworks and regulatory oversight, ensuring that the deployment of FER systems does not infringe on individual rights or perpetuate biases.

Cite

APA

Mattioli, M., & Cabitza, F. (2024). Not in My Face: Challenges and Ethical Considerations in Automatic Face Emotion Recognition Technology. Machine Learning and Knowledge Extraction, 6(4), 2201-2231. https://doi.org/10.3390/make6040109

Vancouver

Mattioli M, Cabitza F. Not in My Face: Challenges and Ethical Considerations in Automatic Face Emotion Recognition Technology. Machine Learning and Knowledge Extraction. 2024;6(4):2201-2231. doi:10.3390/make6040109

BibTeX
@article{Mattioli2024,
  author = {Mattioli, Martina and Cabitza, Federico},
  title = {Not in My Face: Challenges and Ethical Considerations in Automatic Face Emotion Recognition Technology},
  journal = {Machine Learning and Knowledge Extraction},
  year = {2024},
  volume = {6},
  number = {4},
  pages = {2201--2231},
  doi = {10.3390/make6040109}
}
Start for free →