Advances in Facial Expression Recognition: A Survey of Methods, Benchmarks, Models, and Datasets
Information · 28.02.2024 · 15 (3) · 135
DOI: 10.3390/info15030135 ↗Kurz gefasst
Fachartikel in der Zeitschrift Information, online erschienen am 28.02.2024. Verfasst von Thomas Kopalidis und 3 weiteren Autor:innen. Die Arbeit wurde bisher 147-mal zitiert (Crossref) und nennt 304 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: H2020 European Project affecTive basEd iNtegrateD carE for betteR Quality of Life TeNDER.
Abstract (Originalsprache)
Recent technological developments have enabled computers to identify and categorize facial expressions to determine a person’s emotional state in an image or a video. This process, called “Facial Expression Recognition (FER)”, has become one of the most popular research areas in computer vision. In recent times, deep FER systems have primarily concentrated on addressing two significant challenges: the problem of overfitting due to limited training data availability, and the presence of expression-unrelated variations, including illumination, head pose, image resolution, and identity bias. In this paper, a comprehensive survey is provided on deep FER, encompassing algorithms and datasets that offer insights into these intrinsic problems. Initially, this paper presents a detailed timeline showcasing the evolution of methods and datasets in deep facial expression recognition (FER). This timeline illustrates the progression and development of the techniques and data resources used in FER. Then, a comprehensive review of FER methods is introduced, including the basic principles of FER (components such as preprocessing, feature extraction and classification, and methods, etc.) from the pro-deep learning era (traditional methods using handcrafted features, i.e., SVM and HOG, etc.) to the deep learning era. Moreover, a brief introduction is provided related to the benchmark datasets (there are two categories: controlled environments (lab) and uncontrolled environments (in the wild)) used to evaluate different FER methods and a comparison of different FER models. Existing deep neural networks and related training strategies designed for FER, based on static images and dynamic image sequences, are discussed. The remaining challenges and corresponding opportunities in FER and the future directions for designing robust deep FER systems are also pinpointed.
Förderung
- H2020 European Project affecTive basEd iNtegrateD carE for betteR Quality of Life TeNDER
Zitieren
APA
Kopalidis, T., Solachidis, V., Vretos, N., & Daras, P. (2024). Advances in Facial Expression Recognition: A Survey of Methods, Benchmarks, Models, and Datasets. Information, 15(3), 135. https://doi.org/10.3390/info15030135
Vancouver
Kopalidis T, Solachidis V, Vretos N, Daras P. Advances in Facial Expression Recognition: A Survey of Methods, Benchmarks, Models, and Datasets. Information. 2024;15(3):135. doi:10.3390/info15030135
BibTeX
@article{Kopalidis2024,
author = {Kopalidis, Thomas and Solachidis, Vassilios and Vretos, Nicholas and Daras, Petros},
title = {Advances in Facial Expression Recognition: A Survey of Methods, Benchmarks, Models, and Datasets},
journal = {Information},
year = {2024},
volume = {15},
number = {3},
pages = {135},
doi = {10.3390/info15030135}
}
EUVIMED