EUVIMEDOpdag EUVIMED
Open access · CC BY 4.0

Dynamic Occlusion-Aware Facial Expression Recognition Guided by AA-ViT

Xiangwei Mou, Xiuping Xie, Yongfu Song, Rijun Wang

Electronics · 2026-02-11 · 15 (4) · 764

DOI: 10.3390/electronics15040764 ↗

At a glance

Journal article in Electronics, published online on 2026-02-11. Written by Xiangwei Mou and 3 co-authors. Cited 4 times so far (Crossref); 50 references. The full text is freely available (open access, CC BY 4.0). Funded by: Natural Science Foundation Project of Guangxi Normal University.

AbstractBibliografiske oplysningerCiteRelated studies

Abstract (original language)

In complex natural scenarios, facial expression recognition often encounters partial occlusions caused by glasses, hand gestures, and hairstyles, making it difficult for models to extract effective features and thereby reducing recognition accuracy. Existing methods often employ attention mechanisms to enhance expression-related features, but they fail to adequately address the issue where high-frequency responses in occluded regions can disperse attention weights (e.g., incorrectly focus on occluded areas), making it challenging to effectively utilize local cues around the occlusions and limiting performance improvement. To address this, this paper proposes a network based on an adaptive attention mechanism (Adaptive Attention Vision Transformer, AA-ViT). First, an Adaptive Attention module (ADA) is designed to dynamically adjust attention scores in occluded regions, enhancing the effective information in features. Next, a Dual-Branch Multi-Layer Perceptron (DB-MLP) replaces the single linear layer to improve feature representation and model classification capability. Additionally, a Random Erasure (RE) strategy is introduced to enhance model robustness. Finally, to address the issue of model training instability caused by class imbalance in the training dataset, a hybrid loss function combining Focal Loss and Cross-Entropy Loss is adopted to ensure training stability. Experimental results show that AA-ViT achieves expression recognition accuracies of 90.66% and 90.01% on the RAF-DB and FERPlus datasets, respectively, representing improvements of 4.58 and 18.9 percentage points over the baseline ViT model, with only a 24.3% increase in parameter count. Compared to existing methods, the proposed approach demonstrates superior performance in occluded facial expression recognition tasks.

Funding

  • Natural Science Foundation Project of Guangxi Normal University

Cite

APA

Mou, X., Xie, X., Song, Y., & Wang, R. (2026). Dynamic Occlusion-Aware Facial Expression Recognition Guided by AA-ViT. Electronics, 15(4), 764. https://doi.org/10.3390/electronics15040764

Vancouver

Mou X, Xie X, Song Y, Wang R. Dynamic Occlusion-Aware Facial Expression Recognition Guided by AA-ViT. Electronics. 2026;15(4):764. doi:10.3390/electronics15040764

BibTeX
@article{Mou2026,
  author = {Mou, Xiangwei and Xie, Xiuping and Song, Yongfu and Wang, Rijun},
  title = {Dynamic Occlusion-Aware Facial Expression Recognition Guided by AA-ViT},
  journal = {Electronics},
  year = {2026},
  volume = {15},
  number = {4},
  pages = {764},
  doi = {10.3390/electronics15040764}
}
Start for free →