EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Masked Face Emotion Recognition Based on Facial Landmarks and Deep Learning Approaches for Visually Impaired People

Mukhriddin Mukhiddinov iD, Oybek Djuraev iD, Farkhod Akhmedov iD, Abdinabi Mukhamadiyev iD, Jinsoo Cho

Sensors · 17.01.2023 · 23 (3) · 1080

DOI: 10.3390/s23031080 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 17.01.2023. Verfasst von Mukhriddin Mukhiddinov und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Computer Engineering, Gachon University, Seongnam 13120, Republic of Korea. Hauptthemen laut MEDLINE: Facial Recognition, Deep Learning. Die Arbeit wurde bisher 114-mal zitiert (Crossref) und nennt 89 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: This research was supported by the National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIT), GRRC program of Gyeonggi province.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Current artificial intelligence systems for determining a person’s emotions rely heavily on lip and mouth movement and other facial features such as eyebrows, eyes, and the forehead. Furthermore, low-light images are typically classified incorrectly because of the dark region around the eyes and eyebrows. In this work, we propose a facial emotion recognition method for masked facial images using low-light image enhancement and feature analysis of the upper features of the face with a convolutional neural network. The proposed approach employs the AffectNet image dataset, which includes eight types of facial expressions and 420,299 images. Initially, the facial input image’s lower parts are covered behind a synthetic mask. Boundary and regional representation methods are used to indicate the head and upper features of the face. Secondly, we effectively adopt a facial landmark detection method-based feature extraction strategy using the partially covered masked face’s features. Finally, the features, the coordinates of the landmarks that have been identified, and the histograms of the oriented gradients are then incorporated into the classification procedure using a convolutional neural network. An experimental evaluation shows that the proposed method surpasses others by achieving an accuracy of 69.3% on the AffectNet dataset.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Facial RecognitionDeep LearningHumansArtificial IntelligenceEmotionsNeural Networks, ComputerFacial Expression

Stichwörter der Autor:innen

computer visionconvolutional neural networkdeep learningemotion recognitionfacial expression recognitionfacial landmarksvisually impaired people

Autor:innen und Institutionen

  • Department of Computer Engineering, Gachon University, Seongnam 13120, Republic of Korea.
  • Department of Hardware and Software of Control Systems in Telecommunication, Tashkent University of Information Technologies Named after Muhammad al-Khwarizmi, Tashkent 100084, Uzbekistan.

ORCID-Profile: Mukhriddin Mukhiddinov, Oybek Djuraev, Farkhod Akhmedov, Abdinabi Mukhamadiyev

Förderung

  • This research was supported by the National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIT)
  • GRRC program of Gyeonggi province

Zitieren

APA

Mukhiddinov, M., Djuraev, O., Akhmedov, F., Mukhamadiyev, A., & Cho, J. (2023). Masked Face Emotion Recognition Based on Facial Landmarks and Deep Learning Approaches for Visually Impaired People. Sensors, 23(3), 1080. https://doi.org/10.3390/s23031080

Vancouver

Mukhiddinov M, Djuraev O, Akhmedov F, Mukhamadiyev A, Cho J. Masked Face Emotion Recognition Based on Facial Landmarks and Deep Learning Approaches for Visually Impaired People. Sensors. 2023;23(3):1080. doi:10.3390/s23031080

BibTeX
@article{Mukhiddinov2023,
  author = {Mukhiddinov, Mukhriddin and Djuraev, Oybek and Akhmedov, Farkhod and Mukhamadiyev, Abdinabi and Cho, Jinsoo},
  title = {Masked Face Emotion Recognition Based on Facial Landmarks and Deep Learning Approaches for Visually Impaired People},
  journal = {Sensors},
  year = {2023},
  volume = {23},
  number = {3},
  pages = {1080},
  doi = {10.3390/s23031080}
}
Kostenlos starten →