EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Context Transformer and Adaptive Method with Visual Transformer for Robust Facial Expression Recognition

Lingxin Xiong, Jicun Zhang, Xiaojia Zheng, Yuxin Wang

Applied Sciences · 14.02.2024 · 14 (4) · 1535

DOI: 10.3390/app14041535 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 14.02.2024. Verfasst von Lingxin Xiong und 3 weiteren Autor:innen. Die Arbeit wurde bisher 18-mal zitiert (Crossref) und nennt 55 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In real-world scenarios, the facial expression recognition task faces several challenges, including lighting variations, image noise, face occlusion, and other factors, which limit the performance of existing models in dealing with complex situations. To cope with these problems, we introduce the CoT module between the CNN and ViT frameworks, which improves the ability to perceive subtle differences by learning the correlations between local area features at a fine-grained level, helping to maintain the consistency between the local area features and the global expression, and making the model more adaptable to complex lighting conditions. Meanwhile, we adopt an adaptive learning method to effectively eliminate the interference of noise and occlusion by dynamically adjusting the parameters of the Transformer Encoder’s self-attention weight matrix. Experiments demonstrate the accuracy of our CoT_AdaViT model in the Oulu-CASIA dataset as (NIR: 87.94%, VL: strong: 89.47%, weak: 84.76%, dark: 82.28%). As well as, CK+, RAF-DB, and FERPlus datasets achieved 99.20%, 91.07%, and 90.57% recognition results, which achieved excellent performance and verified that the model has strong recognition accuracy and robustness in complex scenes.

Zitieren

APA

Xiong, L., Zhang, J., Zheng, X., & Wang, Y. (2024). Context Transformer and Adaptive Method with Visual Transformer for Robust Facial Expression Recognition. Applied Sciences, 14(4), 1535. https://doi.org/10.3390/app14041535

Vancouver

Xiong L, Zhang J, Zheng X, Wang Y. Context Transformer and Adaptive Method with Visual Transformer for Robust Facial Expression Recognition. Applied Sciences. 2024;14(4):1535. doi:10.3390/app14041535

BibTeX
@article{Xiong2024,
  author = {Xiong, Lingxin and Zhang, Jicun and Zheng, Xiaojia and Wang, Yuxin},
  title = {Context Transformer and Adaptive Method with Visual Transformer for Robust Facial Expression Recognition},
  journal = {Applied Sciences},
  year = {2024},
  volume = {14},
  number = {4},
  pages = {1535},
  doi = {10.3390/app14041535}
}
Kostenlos starten →