Systematic Review of Emotion Detection with Computer Vision and Deep Learning
Sensors · 28.05.2024 · 24 (11) · 3484
DOI: 10.3390/s24113484 ↗Kurz gefasst
Systematische Übersicht in der Zeitschrift Sensors, online erschienen am 28.05.2024. Verfasst von Rafael Pereira und 7 weiteren Autor:innen. Beteiligte Einrichtung: Computer Science and Communications Research Centre, School of Technology and Management, Polytechnic of Leiria, 2411-901 Leiria, Portugal. Hauptthemen laut MEDLINE: Deep Learning, Emotions, Neural Networks, Computer, Facial Expression. Die Arbeit wurde bisher 69-mal zitiert (Crossref) und nennt 144 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Portuguese Foundation for Science 761 and Technology (FCT), I.P., Portuguese Foundation for Science and Technology (FCT), I.P..
Abstract (Originalsprache)
Emotion recognition has become increasingly important in the field of Deep Learning (DL) and computer vision due to its broad applicability by using human–computer interaction (HCI) in areas such as psychology, healthcare, and entertainment. In this paper, we conduct a systematic review of facial and pose emotion recognition using DL and computer vision, analyzing and evaluating 77 papers from different sources under Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Our review covers several topics, including the scope and purpose of the studies, the methods employed, and the used datasets. The scope of this work is to conduct a systematic review of facial and pose emotion recognition using DL methods and computer vision. The studies were categorized based on a proposed taxonomy that describes the type of expressions used for emotion detection, the testing environment, the currently relevant DL methods, and the datasets used. The taxonomy of methods in our review includes Convolutional Neural Network (CNN), Faster Region-based Convolutional Neural Network (R-CNN), Vision Transformer (ViT), and “Other NNs”, which are the most commonly used models in the analyzed studies, indicating their trendiness in the field. Hybrid and augmented models are not explicitly categorized within this taxonomy, but they are still important to the field. This review offers an understanding of state-of-the-art computer vision algorithms and datasets for emotion recognition through facial expressions and body poses, allowing researchers to understand its fundamental components and trends.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Computer Science and Communications Research Centre, School of Technology and Management, Polytechnic of Leiria, 2411-901 Leiria, Portugal.
- INOV INESC Inovação, Institute of New Technologies, Leiria Office, 2411-901 Leiria, Portugal.
ORCID-Profile: Rafael Pereira, Carla Mendes, José Ribeiro, Roberto Ribeiro, Rolando Miragaia, Nuno Rodrigues, Nuno Costa, António Pereira
Förderung
- Portuguese Foundation for Science 761 and Technology (FCT), I.P.
- Portuguese Foundation for Science and Technology (FCT), I.P.
Zitieren
APA
Pereira, R., Mendes, C., Ribeiro, J., Ribeiro, R., Miragaia, R., Rodrigues, N., Costa, N., & Pereira, A. (2024). Systematic Review of Emotion Detection with Computer Vision and Deep Learning. Sensors, 24(11), 3484. https://doi.org/10.3390/s24113484
Vancouver
Pereira R, Mendes C, Ribeiro J, Ribeiro R, Miragaia R, Rodrigues N, et al. Systematic Review of Emotion Detection with Computer Vision and Deep Learning. Sensors. 2024;24(11):3484. doi:10.3390/s24113484
BibTeX
@article{Pereira2024,
author = {Pereira, Rafael and Mendes, Carla and Ribeiro, José and Ribeiro, Roberto and Miragaia, Rolando and Rodrigues, Nuno and Costa, Nuno and Pereira, António},
title = {Systematic Review of Emotion Detection with Computer Vision and Deep Learning},
journal = {Sensors},
year = {2024},
volume = {24},
number = {11},
pages = {3484},
doi = {10.3390/s24113484}
}
EUVIMED