FacialNet: facial emotion recognition for mental health analysis using UNet segmentation with transfer learning model
Frontiers in Computational Neuroscience · 11.12.2024 · 18
DOI: 10.3389/fncom.2024.1485121 ↗Kurz gefasst
Fachartikel in der Zeitschrift Frontiers in Computational Neuroscience, online erschienen am 11.12.2024. Verfasst von In-Seop Na und 8 weiteren Autor:innen. Beteiligte Einrichtung: Division of Culture Contents, Chonnam National University, Yeosu, Republic of Korea. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 34 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Facial emotion recognition (FER) can serve as a valuable tool for assessing emotional states, which are often linked to mental health. However, mental health encompasses a broad range of factors that go beyond facial expressions. While FER provides insights into certain aspects of emotional well-being, it can be used in conjunction with other assessments to form a more comprehensive understanding of an individual's mental health. This research work proposes a framework for human FER using UNet image segmentation and transfer learning with the EfficientNetB4 model (called FacialNet). The proposed model demonstrates promising results, achieving an accuracy of 90% for six emotion classes (happy, sad, fear, pain, anger, and disgust) and 96.39% for binary classification (happy and sad). The significance of FacialNet is judged by extensive experiments conducted against various machine learning and deep learning models, as well as state-of-the-art previous research works in FER. The significance of FacialNet is further validated using a cross-validation technique, ensuring reliable performance across different data splits. The findings highlight the effectiveness of leveraging UNet image segmentation and EfficientNetB4 transfer learning for accurate and efficient human facial emotion recognition, offering promising avenues for real-world applications in emotion-aware systems and effective computing platforms. Experimental findings reveal that the proposed approach performs substantially better than existing works with an improved accuracy of 96.39% compared to existing 94.26%.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Division of Culture Contents, Chonnam National University, Yeosu, Republic of Korea.
- Department of Informatics and Computer Systems, College of Computer Science, King Khalid University, Abha, Saudi Arabia.
- Department of Information Technology, Faculty of Computing and Information Technology, King Abdulaziz University, Jeddah, Saudi Arabia.
- Department of Computer Science & Information Technology, The Islamia University of Bahawalpur, Bahawalpur, Pakistan.
- Department of Information Systems, College of Computer and Information Sciences, Princess Nourah bint Abdulrahman University, Riyadh, Saudi Arabia.
- Department of Computer Science, College of Computer Engineering and Sciences, Prince Sattam Bin Abdulaziz University, Al-Kharj, Saudi Arabia.
Zitieren
APA
Na, I. S., Aldrees, A., Hakeem, A., Mohaisen, L., Umer, M., AlHammadi, D. A., Alsubai, S., Innab, N., & Ashraf, I. (2024). FacialNet: facial emotion recognition for mental health analysis using UNet segmentation with transfer learning model. Frontiers in Computational Neuroscience, 18. https://doi.org/10.3389/fncom.2024.1485121
Vancouver
Na IS, Aldrees A, Hakeem A, Mohaisen L, Umer M, AlHammadi DA, et al. FacialNet: facial emotion recognition for mental health analysis using UNet segmentation with transfer learning model. Frontiers in Computational Neuroscience. 2024;18. doi:10.3389/fncom.2024.1485121
BibTeX
@article{Na2024,
author = {Na, In-Seop and Aldrees, Asma and Hakeem, Abeer and Mohaisen, Linda and Umer, Muhammad and AlHammadi, Dina Abdulaziz and Alsubai, Shtwai and Innab, Nisreen and Ashraf, Imran},
title = {FacialNet: facial emotion recognition for mental health analysis using UNet segmentation with transfer learning model},
journal = {Frontiers in Computational Neuroscience},
year = {2024},
volume = {18},
doi = {10.3389/fncom.2024.1485121}
}
EUVIMED