EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Harmonious Mutual Learning for Facial Emotion Recognition

Yanling Gan, Luhui Xu, Haiying Xia, Gan Liu

Neural Processing Letters · 07.03.2024 · 56 (2)

DOI: 10.1007/s11063-024-11566-4 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Neural Processing Letters, online erschienen am 07.03.2024. Verfasst von Yanling Gan und 3 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 43 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Guangxi Universities Young and Middle-aged Teachers Basic Ability Improvement Project, National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Facial emotion recognition in the wild is an important task in computer vision, but it still remains challenging since the influence of backgrounds, occlusions and illumination variations in facial images, as well as the ambiguity of expressions. This paper proposes a harmonious mutual learning framework for emotion recognition, mainly through utilizing attention mechanisms and probability distributions without utilizing additional information. Specifically, this paper builds an architecture with two emotion recognition networks and makes progressive cooperation and interaction between them. We first integrate self-mutual attention module into the backbone to learn discriminative features against the influence from emotion-irrelevant facial information. In this process, we deploy spatial attention module and convolutional block attention module for the two networks respectively, guiding to enhanced and supplementary learning of attention. Further, in the classification head, we propose to learn the latent ground-truth emotion probability distributions using softmax function with temperature to characterize the expression ambiguity. On this basis, a probability distribution distillation learning module is constructed to perform class semantic interaction using bi-directional KL loss, allowing mutual calibration for the two networks. Experimental results on three public datasets show the superiority of the proposed method compared to state-of-the-art ones.

Förderung

  • Guangxi Universities Young and Middle-aged Teachers Basic Ability Improvement Project
  • National Natural Science Foundation of China

Zitieren

APA

Gan, Y., Xu, L., Xia, H., & Liu, G. (2024). Harmonious Mutual Learning for Facial Emotion Recognition. Neural Processing Letters, 56(2). https://doi.org/10.1007/s11063-024-11566-4

Vancouver

Gan Y, Xu L, Xia H, Liu G. Harmonious Mutual Learning for Facial Emotion Recognition. Neural Processing Letters. 2024;56(2). doi:10.1007/s11063-024-11566-4

BibTeX
@article{Gan2024,
  author = {Gan, Yanling and Xu, Luhui and Xia, Haiying and Liu, Gan},
  title = {Harmonious Mutual Learning for Facial Emotion Recognition},
  journal = {Neural Processing Letters},
  year = {2024},
  volume = {56},
  number = {2},
  doi = {10.1007/s11063-024-11566-4}
}
Kostenlos starten →