EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

FER-EMFormer: An enhanced mamba-transformer network for facial expression recognition

Weijun Gong, Xusheng Du, Jiaxin Wu, Zhichao Peng

Journal of King Saud University Computer and Information Sciences · 2026-08 · 38 (6)

DOI: 10.1007/s44443-026-00740-4 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of King Saud University Computer and Information Sciences, online erschienen am 07.05.2026. Verfasst von Weijun Gong und 3 weiteren Autor:innen. Die Arbeit nennt 81 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Natural Science Foundation of Gansu Province Science and Technology Plan, Doctoral Research Foundation of Hexi University.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Facial expression recognition (FER) has a variety of applications in advanced intelligent fields such as human–computer interaction, cognitive psychology, and intelligent driving. However, FER in wild scenarios faces multiple challenges, including occlusion, pose variations, and subtle differences, which make current models unable to address these issues effectively. To tackle these challenges, we propose an efficient and robust Enhanced Mamba-Transformer architecture for FER (FER-EMFormer) in complex scenes. The FER-EMFormer primarily consists of two core modules: the Hybrid Enhanced Mamba-Transformer (HEMT) and the Enhanced Cascaded Mamba-Transformer (ECMT). HEMT effectively combines Mamba and Transformer to capture informative global context and spatial dependency features, while integrating detail feature frequency enhancement across multiple views to enable collaborative global–local feature understanding. ECMT uses a cascaded architecture to fuse the optimized global dependencies obtained from Mamba-Transformer, then employs a Transformer with a multi-dimensional aggregation feedforward network to precisely control the network's information flow, yielding high-density discriminative information and further improving the accuracy of facial expression recognition. Extensive experiments show that our FER-EMFormer significantly outperforms current FER models and achieves state-of-the-art performance of 96.06% on RAF-DB, 95.78% on FERPlus, 72.91% on AffectNet-7, and 70.43% on AffectNet-8, while simultaneously demonstrating excellent robustness and generalization capabilities on occlusion and pose variation expression datasets as well as cross-dataset. The code is available at https://github.com/ferlab08/FER-EMFormer

Förderung

  • National Natural Science Foundation of China
  • Natural Science Foundation of Gansu Province Science and Technology Plan
  • Doctoral Research Foundation of Hexi University

Zitieren

APA

Gong, W., Du, X., Wu, J., & Peng, Z. (2026). FER-EMFormer: An enhanced mamba-transformer network for facial expression recognition. Journal of King Saud University Computer and Information Sciences, 38(6). https://doi.org/10.1007/s44443-026-00740-4

Vancouver

Gong W, Du X, Wu J, Peng Z. FER-EMFormer: An enhanced mamba-transformer network for facial expression recognition. Journal of King Saud University Computer and Information Sciences. 2026;38(6). doi:10.1007/s44443-026-00740-4

BibTeX
@article{Gong2026,
  author = {Gong, Weijun and Du, Xusheng and Wu, Jiaxin and Peng, Zhichao},
  title = {FER-EMFormer: An enhanced mamba-transformer network for facial expression recognition},
  journal = {Journal of King Saud University Computer and Information Sciences},
  year = {2026},
  volume = {38},
  number = {6},
  doi = {10.1007/s44443-026-00740-4}
}
Kostenlos starten →