EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Facial Emotion Recognition Combining Auxiliary Classifiers and Multiscale CBAM Attention Mechanisms

Yujie Shang, Fei Yan, Yunqing Liu, Qi Li, Qiong Zhang

IEEE Access · 2024 · 12 · 57356-57365

DOI: 10.1109/access.2024.3391057 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Access, 2024. Verfasst von Yujie Shang und 4 weiteren Autor:innen. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 46 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: Science and Technology Development Plan Project of Jilin Province, China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Facial emotions are the most intuitive way to react to changes in inner emotions. We propose a facial emotion recognition method that combines auxiliary classifiers (Acs) and multi-scale CBAM (MCBAM) by improving the Xception network model. And we design a lightweight network model AMDCNN. We introduce Acs in the middle layers of the model. The features extracted from the middle layer portion of the model are utilized to aid in emotion recognition. Finally, the recognition results of the Acs and the main classifier are adaptively weighted and fused to obtain better emotion recognition results. This enables better utilization of the feature information extracted from the intermediate layers and further reduces the feature loss caused by the downsampling process of the convolutional layer. The CBAM does not increase the number of parameters and computation too much, and it enables the model to better focus on the important areas of the face. We apply it to the proposed lightweight model and improve it further. The width is increased by introducing a multi-branch convolutional structure and utilizing convolutional layers with different kernel sizes. This allows for more adequate spatial and channel features during feature extraction, allowing the model to more accurately focus on important facial regions. Our proposed model was experimentally validated on datasets of FER2013, FERPlus, RAF-DB and CK+, with accuracies of 69.82%, 85.40%, 86.77% and 99.49%, respectively. The number of parameters of the proposed model is only 1.6M. Our model is a good competitive advantage compared with other lightweight models.

Förderung

  • Science and Technology Development Plan Project of Jilin Province, China

Zitieren

APA

Shang, Y., Yan, F., Liu, Y., Li, Q., & Zhang, Q. (2024). Facial Emotion Recognition Combining Auxiliary Classifiers and Multiscale CBAM Attention Mechanisms. IEEE Access, 12, 57356-57365. https://doi.org/10.1109/access.2024.3391057

Vancouver

Shang Y, Yan F, Liu Y, Li Q, Zhang Q. Facial Emotion Recognition Combining Auxiliary Classifiers and Multiscale CBAM Attention Mechanisms. IEEE Access. 2024;12:57356-57365. doi:10.1109/access.2024.3391057

BibTeX
@article{Shang2024,
  author = {Shang, Yujie and Yan, Fei and Liu, Yunqing and Li, Qi and Zhang, Qiong},
  title = {Facial Emotion Recognition Combining Auxiliary Classifiers and Multiscale CBAM Attention Mechanisms},
  journal = {IEEE Access},
  year = {2024},
  volume = {12},
  pages = {57356--57365},
  doi = {10.1109/access.2024.3391057}
}
Kostenlos starten →