Facial Expression Recognition Based on Fine-Tuned Channel–Spatial Attention Transformer
Sensors · 30.07.2023 · 23 (15) · 6799
DOI: 10.3390/s23156799 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 30.07.2023. Verfasst von Huang Yao und 4 weiteren Autor:innen. Beteiligte Einrichtung: Faculty of Artificial Intelligence in Education, Central China Normal University, Wuhan 430079, China. Hauptthemen laut MEDLINE: Facial Recognition. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 42 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Collaborative Innovation Center for Informatization and Balanced Development of K-12 Education by MOE and Hubei Province.
Abstract (Originalsprache)
Facial expressions help individuals convey their emotions. In recent years, thanks to the development of computer vision technology, facial expression recognition (FER) has become a research hotspot and made remarkable progress. However, human faces in real-world environments are affected by various unfavorable factors, such as facial occlusion and head pose changes, which are seldom encountered in controlled laboratory settings. These factors often lead to a reduction in expression recognition accuracy. Inspired by the recent success of transformers in many computer vision tasks, we propose a model called the fine-tuned channel–spatial attention transformer (FT-CSAT) to improve the accuracy of recognition of FER in the wild. FT-CSAT consists of two crucial components: channel–spatial attention module and fine-tuning module. In the channel–spatial attention module, the feature map is input into the channel attention module and the spatial attention module sequentially. The final output feature map will effectively incorporate both channel information and spatial information. Consequently, the network becomes adept at focusing on relevant and meaningful features associated with facial expressions. To further improve the model’s performance while controlling the number of excessive parameters, we employ a fine-tuning method. Extensive experimental results demonstrate that our FT-CSAT outperforms the state-of-the-art methods on two benchmark datasets: RAF-DB and FERPlus. The achieved recognition accuracy is 88.61% and 89.26%, respectively. Furthermore, to evaluate the robustness of FT-CSAT in the case of facial occlusion and head pose changes, we take tests on Occlusion-RAF-DB and Pose-RAF-DB data sets, and the results also show that the superior recognition performance of the proposed method under such conditions.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Faculty of Artificial Intelligence in Education, Central China Normal University, Wuhan 430079, China.
Förderung
- Collaborative Innovation Center for Informatization and Balanced Development of K-12 Education by MOE and Hubei Province
Zitieren
APA
Yao, H., Yang, X., Chen, D., Wang, Z., & Tian, Y. (2023). Facial Expression Recognition Based on Fine-Tuned Channel–Spatial Attention Transformer. Sensors, 23(15), 6799. https://doi.org/10.3390/s23156799
Vancouver
Yao H, Yang X, Chen D, Wang Z, Tian Y. Facial Expression Recognition Based on Fine-Tuned Channel–Spatial Attention Transformer. Sensors. 2023;23(15):6799. doi:10.3390/s23156799
BibTeX
@article{Yao2023,
author = {Yao, Huang and Yang, Xiaomeng and Chen, Di and Wang, Zhao and Tian, Yuan},
title = {Facial Expression Recognition Based on Fine-Tuned Channel–Spatial Attention Transformer},
journal = {Sensors},
year = {2023},
volume = {23},
number = {15},
pages = {6799},
doi = {10.3390/s23156799}
}
EUVIMED