EUVIMEDEUVIMED entdecken
Systematische ÜbersichtOpen Access · CC BY 4.0

Systematic Review of Emotion Detection with Computer Vision and Deep Learning

Rafael Pereira iD, Carla Mendes iD, José Ribeiro iD, Roberto Ribeiro iD, Rolando Miragaia iD, Nuno Rodrigues iD, Nuno Costa iD, António Pereira iD

Sensors · 28.05.2024 · 24 (11) · 3484

DOI: 10.3390/s24113484 ↗

Kurz gefasst

Systematische Übersicht in der Zeitschrift Sensors, online erschienen am 28.05.2024. Verfasst von Rafael Pereira und 7 weiteren Autor:innen. Beteiligte Einrichtung: Computer Science and Communications Research Centre, School of Technology and Management, Polytechnic of Leiria, 2411-901 Leiria, Portugal. Hauptthemen laut MEDLINE: Deep Learning, Emotions, Neural Networks, Computer, Facial Expression. Die Arbeit wurde bisher 69-mal zitiert (Crossref) und nennt 144 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Portuguese Foundation for Science 761 and Technology (FCT), I.P., Portuguese Foundation for Science and Technology (FCT), I.P..

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Emotion recognition has become increasingly important in the field of Deep Learning (DL) and computer vision due to its broad applicability by using human–computer interaction (HCI) in areas such as psychology, healthcare, and entertainment. In this paper, we conduct a systematic review of facial and pose emotion recognition using DL and computer vision, analyzing and evaluating 77 papers from different sources under Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Our review covers several topics, including the scope and purpose of the studies, the methods employed, and the used datasets. The scope of this work is to conduct a systematic review of facial and pose emotion recognition using DL methods and computer vision. The studies were categorized based on a proposed taxonomy that describes the type of expressions used for emotion detection, the testing environment, the currently relevant DL methods, and the datasets used. The taxonomy of methods in our review includes Convolutional Neural Network (CNN), Faster Region-based Convolutional Neural Network (R-CNN), Vision Transformer (ViT), and “Other NNs”, which are the most commonly used models in the analyzed studies, indicating their trendiness in the field. Hybrid and augmented models are not explicitly categorized within this taxonomy, but they are still important to the field. This review offers an understanding of state-of-the-art computer vision algorithms and datasets for emotion recognition through facial expressions and body poses, allowing researchers to understand its fundamental components and trends.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Deep LearningEmotionsNeural Networks, ComputerFacial ExpressionHumans

Stichwörter der Autor:innen

computer visiondeep learningemotion detectionemotion recognitionsystematic review

Autor:innen und Institutionen

  • Computer Science and Communications Research Centre, School of Technology and Management, Polytechnic of Leiria, 2411-901 Leiria, Portugal.
  • INOV INESC Inovação, Institute of New Technologies, Leiria Office, 2411-901 Leiria, Portugal.

ORCID-Profile: Rafael Pereira, Carla Mendes, José Ribeiro, Roberto Ribeiro, Rolando Miragaia, Nuno Rodrigues, Nuno Costa, António Pereira

Förderung

  • Portuguese Foundation for Science 761 and Technology (FCT), I.P.
  • Portuguese Foundation for Science and Technology (FCT), I.P.

Zitieren

APA

Pereira, R., Mendes, C., Ribeiro, J., Ribeiro, R., Miragaia, R., Rodrigues, N., Costa, N., & Pereira, A. (2024). Systematic Review of Emotion Detection with Computer Vision and Deep Learning. Sensors, 24(11), 3484. https://doi.org/10.3390/s24113484

Vancouver

Pereira R, Mendes C, Ribeiro J, Ribeiro R, Miragaia R, Rodrigues N, et al. Systematic Review of Emotion Detection with Computer Vision and Deep Learning. Sensors. 2024;24(11):3484. doi:10.3390/s24113484

BibTeX
@article{Pereira2024,
  author = {Pereira, Rafael and Mendes, Carla and Ribeiro, José and Ribeiro, Roberto and Miragaia, Rolando and Rodrigues, Nuno and Costa, Nuno and Pereira, António},
  title = {Systematic Review of Emotion Detection with Computer Vision and Deep Learning},
  journal = {Sensors},
  year = {2024},
  volume = {24},
  number = {11},
  pages = {3484},
  doi = {10.3390/s24113484}
}
Kostenlos starten →