Masked Face Emotion Recognition Based on Facial Landmarks and Deep Learning Approaches for Visually Impaired People
Sensors · 17.01.2023 · 23 (3) · 1080
DOI: 10.3390/s23031080 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 17.01.2023. Verfasst von Mukhriddin Mukhiddinov und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Computer Engineering, Gachon University, Seongnam 13120, Republic of Korea. Hauptthemen laut MEDLINE: Facial Recognition, Deep Learning. Die Arbeit wurde bisher 114-mal zitiert (Crossref) und nennt 89 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: This research was supported by the National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIT), GRRC program of Gyeonggi province.
Abstract (Originalsprache)
Current artificial intelligence systems for determining a person’s emotions rely heavily on lip and mouth movement and other facial features such as eyebrows, eyes, and the forehead. Furthermore, low-light images are typically classified incorrectly because of the dark region around the eyes and eyebrows. In this work, we propose a facial emotion recognition method for masked facial images using low-light image enhancement and feature analysis of the upper features of the face with a convolutional neural network. The proposed approach employs the AffectNet image dataset, which includes eight types of facial expressions and 420,299 images. Initially, the facial input image’s lower parts are covered behind a synthetic mask. Boundary and regional representation methods are used to indicate the head and upper features of the face. Secondly, we effectively adopt a facial landmark detection method-based feature extraction strategy using the partially covered masked face’s features. Finally, the features, the coordinates of the landmarks that have been identified, and the histograms of the oriented gradients are then incorporated into the classification procedure using a convolutional neural network. An experimental evaluation shows that the proposed method surpasses others by achieving an accuracy of 69.3% on the AffectNet dataset.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Computer Engineering, Gachon University, Seongnam 13120, Republic of Korea.
- Department of Hardware and Software of Control Systems in Telecommunication, Tashkent University of Information Technologies Named after Muhammad al-Khwarizmi, Tashkent 100084, Uzbekistan.
ORCID-Profile: Mukhriddin Mukhiddinov, Oybek Djuraev, Farkhod Akhmedov, Abdinabi Mukhamadiyev
Förderung
- This research was supported by the National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIT)
- GRRC program of Gyeonggi province
Zitieren
APA
Mukhiddinov, M., Djuraev, O., Akhmedov, F., Mukhamadiyev, A., & Cho, J. (2023). Masked Face Emotion Recognition Based on Facial Landmarks and Deep Learning Approaches for Visually Impaired People. Sensors, 23(3), 1080. https://doi.org/10.3390/s23031080
Vancouver
Mukhiddinov M, Djuraev O, Akhmedov F, Mukhamadiyev A, Cho J. Masked Face Emotion Recognition Based on Facial Landmarks and Deep Learning Approaches for Visually Impaired People. Sensors. 2023;23(3):1080. doi:10.3390/s23031080
BibTeX
@article{Mukhiddinov2023,
author = {Mukhiddinov, Mukhriddin and Djuraev, Oybek and Akhmedov, Farkhod and Mukhamadiyev, Abdinabi and Cho, Jinsoo},
title = {Masked Face Emotion Recognition Based on Facial Landmarks and Deep Learning Approaches for Visually Impaired People},
journal = {Sensors},
year = {2023},
volume = {23},
number = {3},
pages = {1080},
doi = {10.3390/s23031080}
}
EUVIMED