EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Effect of Attention Block in Learning of Facial Expressions Using Teacher–Student Knowledge Distillation

Ioana Diana Moldovanu, Cătălin Anghel, Sanda Florentina Mihalache, Simona Moldovanu

Knowledge · 16.11.2026 · 6 (4) · 30

DOI: 10.3390/knowledge6040030 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Knowledge, online erschienen am 16.11.2026. Verfasst von Ioana Diana Moldovanu und 3 weiteren Autor:innen. Die Arbeit nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Facial expression recognition (FER) is a rapidly evolving field of study with various applications in psychology, security, and computer science. Nonverbal cues, such as body language, gestures, and facial expressions, are important in daily life because they can convey more about the feelings and desires of a person. AI systems can enhance relationships and social interactions by recognizing these signals. This study contributes to this field by including a knowledge distillation (KD) process, with teacher models (TM) based on a large pre-trained convolutional neural network (CNN) and student models (SM) consisting of a smaller pre-trained CNN and classifiers. In the KD process, the teacher (TM) and student (SM) models proposed were Res-Net101/ResNet50, EfficientNetB7/EfficientNetB0, and MobileNetV3-large/MobileNetV3-small. The AffectNet and Real-world Affective Faces Database (RAF-DB) datasets were used for general steps learning. In an ablation process, the salient TM and SM were trained on the datasets. The CBAM (Convolutional Block Attention Module), ECA (Efficient Channel Attention), and FcaNet (Frequency Channel Attention Network) attention blocks were inserted after the last convolutional block in both TM and SM, or sequentially, with the aim of refining the deep features and improving the performance of CNNs.

Zitieren

APA

Moldovanu, I. D., Anghel, C., Mihalache, S. F., & Moldovanu, S. (2026). Effect of Attention Block in Learning of Facial Expressions Using Teacher–Student Knowledge Distillation. Knowledge, 6(4), 30. https://doi.org/10.3390/knowledge6040030

Vancouver

Moldovanu ID, Anghel C, Mihalache SF, Moldovanu S. Effect of Attention Block in Learning of Facial Expressions Using Teacher–Student Knowledge Distillation. Knowledge. 2026;6(4):30. doi:10.3390/knowledge6040030

BibTeX
@article{Moldovanu2026,
  author = {Moldovanu, Ioana Diana and Anghel, Cătălin and Mihalache, Sanda Florentina and Moldovanu, Simona},
  title = {Effect of Attention Block in Learning of Facial Expressions Using Teacher–Student Knowledge Distillation},
  journal = {Knowledge},
  year = {2026},
  volume = {6},
  number = {4},
  pages = {30},
  doi = {10.3390/knowledge6040030}
}
Kostenlos starten →