EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Dynamic Occlusion-Aware Facial Expression Recognition Guided by AA-ViT

Xiangwei Mou, Xiuping Xie, Yongfu Song, Rijun Wang

Electronics · 11.02.2026 · 15 (4) · 764

DOI: 10.3390/electronics15040764 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Electronics, online erschienen am 11.02.2026. Verfasst von Xiangwei Mou und 3 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 50 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Natural Science Foundation Project of Guangxi Normal University.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In complex natural scenarios, facial expression recognition often encounters partial occlusions caused by glasses, hand gestures, and hairstyles, making it difficult for models to extract effective features and thereby reducing recognition accuracy. Existing methods often employ attention mechanisms to enhance expression-related features, but they fail to adequately address the issue where high-frequency responses in occluded regions can disperse attention weights (e.g., incorrectly focus on occluded areas), making it challenging to effectively utilize local cues around the occlusions and limiting performance improvement. To address this, this paper proposes a network based on an adaptive attention mechanism (Adaptive Attention Vision Transformer, AA-ViT). First, an Adaptive Attention module (ADA) is designed to dynamically adjust attention scores in occluded regions, enhancing the effective information in features. Next, a Dual-Branch Multi-Layer Perceptron (DB-MLP) replaces the single linear layer to improve feature representation and model classification capability. Additionally, a Random Erasure (RE) strategy is introduced to enhance model robustness. Finally, to address the issue of model training instability caused by class imbalance in the training dataset, a hybrid loss function combining Focal Loss and Cross-Entropy Loss is adopted to ensure training stability. Experimental results show that AA-ViT achieves expression recognition accuracies of 90.66% and 90.01% on the RAF-DB and FERPlus datasets, respectively, representing improvements of 4.58 and 18.9 percentage points over the baseline ViT model, with only a 24.3% increase in parameter count. Compared to existing methods, the proposed approach demonstrates superior performance in occluded facial expression recognition tasks.

Förderung

  • Natural Science Foundation Project of Guangxi Normal University

Zitieren

APA

Mou, X., Xie, X., Song, Y., & Wang, R. (2026). Dynamic Occlusion-Aware Facial Expression Recognition Guided by AA-ViT. Electronics, 15(4), 764. https://doi.org/10.3390/electronics15040764

Vancouver

Mou X, Xie X, Song Y, Wang R. Dynamic Occlusion-Aware Facial Expression Recognition Guided by AA-ViT. Electronics. 2026;15(4):764. doi:10.3390/electronics15040764

BibTeX
@article{Mou2026,
  author = {Mou, Xiangwei and Xie, Xiuping and Song, Yongfu and Wang, Rijun},
  title = {Dynamic Occlusion-Aware Facial Expression Recognition Guided by AA-ViT},
  journal = {Electronics},
  year = {2026},
  volume = {15},
  number = {4},
  pages = {764},
  doi = {10.3390/electronics15040764}
}
Kostenlos starten →