EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Facial Expression Recognition Based on Vision Transformer with Hybrid Local Attention

Yuan Tian, Jingxuan Zhu, Huang Yao, Di Chen

Applied Sciences · 24.07.2024 · 14 (15) · 6471

DOI: 10.3390/app14156471 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 24.07.2024. Verfasst von Yuan Tian und 3 weiteren Autor:innen. Die Arbeit wurde bisher 40-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: General Project for Education of National Social Science Fund.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Facial expression recognition has wide application prospects in many occasions. Due to the complexity and variability of facial expressions, facial expression recognition has become a very challenging research topic. This paper proposes a Vision Transformer expression recognition method based on hybrid local attention (HLA-ViT). The network adopts a dual-stream structure. One stream extracts the hybrid local features and the other stream extracts the global contextual features. These two streams constitute a global–local fusion attention. The hybrid local attention module is proposed to enhance the network’s robustness to face occlusion and head pose variations. The convolutional neural network is combined with the hybrid local attention module to obtain feature maps with local prominent information. Robust features are then captured by the ViT from the global perspective of the visual sequence context. Finally, the decision-level fusion mechanism fuses the expression features with local prominent information, adding complementary information to enhance the network’s recognition performance and robustness against interference factors such as occlusion and head posture changes in natural scenes. Extensive experiments demonstrate that our HLA-ViT network achieves an excellent performance with 90.45% on RAF-DB, 90.13% on FERPlus, and 65.07% on AffectNet.

Förderung

  • General Project for Education of National Social Science Fund

Zitieren

APA

Tian, Y., Zhu, J., Yao, H., & Chen, D. (2024). Facial Expression Recognition Based on Vision Transformer with Hybrid Local Attention. Applied Sciences, 14(15), 6471. https://doi.org/10.3390/app14156471

Vancouver

Tian Y, Zhu J, Yao H, Chen D. Facial Expression Recognition Based on Vision Transformer with Hybrid Local Attention. Applied Sciences. 2024;14(15):6471. doi:10.3390/app14156471

BibTeX
@article{Tian2024,
  author = {Tian, Yuan and Zhu, Jingxuan and Yao, Huang and Chen, Di},
  title = {Facial Expression Recognition Based on Vision Transformer with Hybrid Local Attention},
  journal = {Applied Sciences},
  year = {2024},
  volume = {14},
  number = {15},
  pages = {6471},
  doi = {10.3390/app14156471}
}
Kostenlos starten →