VaBTFER: An Effective Variant Binary Transformer for Facial Expression Recognition
Sensors · 27.12.2023 · 24 (1) · 147
DOI: 10.3390/s24010147 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 27.12.2023. Verfasst von Lei Shen und 1 weiteren Autor:innen. Beteiligte Einrichtung: College of Information Science and Technology, Nanjing Forestry University, NanJing 100190, China. Hauptthemen laut MEDLINE: Facial Recognition. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 76 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Existing Transformer-based models have achieved impressive success in facial expression recognition (FER) by modeling the long-range relationships among facial muscle movements. However, the size of pure Transformer-based models tends to be in the million-parameter level, which poses a challenge for deploying these models. Moreover, the lack of inductive bias in Transformer usually leads to the difficulty of training from scratch on limited FER datasets. To address these problems, we propose an effective and lightweight variant Transformer for FER called VaTFER. In VaTFER, we firstly construct action unit (AU) tokens by utilizing action unit-based regions and their histogram of oriented gradient (HOG) features. Then, we present a novel spatial-channel feature relevance Transformer (SCFRT) module, which incorporates multilayer channel reduction self-attention (MLCRSA) and a dynamic learnable information extraction (DLIE) mechanism. MLCRSA is utilized to model long-range dependencies among all tokens and decrease the number of parameters. DLIE’s goal is to alleviate the lack of inductive bias and improve the learning ability of the model. Furthermore, we use an excitation module to replace the vanilla multilayer perception (MLP) for accurate prediction. To further reduce computing and memory resources, we introduce a binary quantization mechanism, formulating a novel lightweight Transformer model called variant binary Transformer for FER (VaBTFER). We conduct extensive experiments on several commonly used facial expression datasets, and the results attest to the effectiveness of our methods.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- College of Information Science and Technology, Nanjing Forestry University, NanJing 100190, China.
Zitieren
APA
Shen, L., & Jin, X. (2023). VaBTFER: An Effective Variant Binary Transformer for Facial Expression Recognition. Sensors, 24(1), 147. https://doi.org/10.3390/s24010147
Vancouver
Shen L, Jin X. VaBTFER: An Effective Variant Binary Transformer for Facial Expression Recognition. Sensors. 2023;24(1):147. doi:10.3390/s24010147
BibTeX
@article{Shen2023,
author = {Shen, Lei and Jin, Xing},
title = {VaBTFER: An Effective Variant Binary Transformer for Facial Expression Recognition},
journal = {Sensors},
year = {2023},
volume = {24},
number = {1},
pages = {147},
doi = {10.3390/s24010147}
}
EUVIMED