EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

VaBTFER: An Effective Variant Binary Transformer for Facial Expression Recognition

Lei Shen, Xing Jin

Sensors · 27.12.2023 · 24 (1) · 147

DOI: 10.3390/s24010147 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 27.12.2023. Verfasst von Lei Shen und 1 weiteren Autor:innen. Beteiligte Einrichtung: College of Information Science and Technology, Nanjing Forestry University, NanJing 100190, China. Hauptthemen laut MEDLINE: Facial Recognition. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 76 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Existing Transformer-based models have achieved impressive success in facial expression recognition (FER) by modeling the long-range relationships among facial muscle movements. However, the size of pure Transformer-based models tends to be in the million-parameter level, which poses a challenge for deploying these models. Moreover, the lack of inductive bias in Transformer usually leads to the difficulty of training from scratch on limited FER datasets. To address these problems, we propose an effective and lightweight variant Transformer for FER called VaTFER. In VaTFER, we firstly construct action unit (AU) tokens by utilizing action unit-based regions and their histogram of oriented gradient (HOG) features. Then, we present a novel spatial-channel feature relevance Transformer (SCFRT) module, which incorporates multilayer channel reduction self-attention (MLCRSA) and a dynamic learnable information extraction (DLIE) mechanism. MLCRSA is utilized to model long-range dependencies among all tokens and decrease the number of parameters. DLIE’s goal is to alleviate the lack of inductive bias and improve the learning ability of the model. Furthermore, we use an excitation module to replace the vanilla multilayer perception (MLP) for accurate prediction. To further reduce computing and memory resources, we introduce a binary quantization mechanism, formulating a novel lightweight Transformer model called variant binary Transformer for FER (VaBTFER). We conduct extensive experiments on several commonly used facial expression datasets, and the results attest to the effectiveness of our methods.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Facial RecognitionElectric Power SuppliesFaceFacial MusclesInformation Storage and Retrieval

Stichwörter der Autor:innen

binary quantization mechanismdynamic learnable information extractionfacial expression recognitionlightweight variant Transformermultilayer channel reduction self-attentionspatial-channel feature relevance Transformer

Autor:innen und Institutionen

  • College of Information Science and Technology, Nanjing Forestry University, NanJing 100190, China.

Zitieren

APA

Shen, L., & Jin, X. (2023). VaBTFER: An Effective Variant Binary Transformer for Facial Expression Recognition. Sensors, 24(1), 147. https://doi.org/10.3390/s24010147

Vancouver

Shen L, Jin X. VaBTFER: An Effective Variant Binary Transformer for Facial Expression Recognition. Sensors. 2023;24(1):147. doi:10.3390/s24010147

BibTeX
@article{Shen2023,
  author = {Shen, Lei and Jin, Xing},
  title = {VaBTFER: An Effective Variant Binary Transformer for Facial Expression Recognition},
  journal = {Sensors},
  year = {2023},
  volume = {24},
  number = {1},
  pages = {147},
  doi = {10.3390/s24010147}
}
Kostenlos starten →