EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Semi-Supervised Facial Emotion Recognition via Valence-Arousal Pseudo-Label Refinement

Seunghyun Kim, Hyunsoo Seo, Ill Hyung Jo, Eui Chul Lee

Electronics · 21.05.2026 · 15 (10) · 2213

DOI: 10.3390/electronics15102213 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Electronics, online erschienen am 21.05.2026. Verfasst von Seunghyun Kim und 3 weiteren Autor:innen. Die Arbeit nennt 24 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministry of Education of the Republic of Korea, National Research Foundation of Korea.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Facial expression recognition is a pivotal area in computer vision, traditionally focusing on categorical labels such as ‘Happy’, and ‘Sad’. Recent advancements have transitioned towards using the continuous indicators valence and arousal, reflecting the complicated nature of human emotions. This study introduces a method using semi-supervised learning to generate valence and arousal labels for existing categorical datasets, addressing challenges like racial bias. We propose a pseudo-label refinement framework, VAP-Refine (Valence-Arousal Pseudo-label Refinement), which enhances facial expression recognition by combining teacher model predictions and category-level statistics. These predicted labels are adjusted using ground truth category information and combined with actual category labels to train a more robust facial expression recognition model. Our approach improved accuracy from 69.3% to 72.26% and from 62.94% to 67.24% across two datasets. Fine-tuning with a teacher model predicting valence and arousal achieved 75.82% and 91.58% accuracy, with an F1-score of 0.9147, despite data imbalances. These results highlight the potential of semi-supervised learning to enhance facial expression recognition by incorporating continuous emotional indicators, improving model performance and contributing to more accurate affective computing applications. Furthermore, the proposed framework consistently improved performance across various backbone architectures, including ResNet50, SHViT, and DDAMFN++, highlighting its generalizability and versatility.

Förderung

  • Ministry of Education of the Republic of Korea
  • National Research Foundation of Korea

Zitieren

APA

Kim, S., Seo, H., Jo, I. H., & Lee, E. C. (2026). Semi-Supervised Facial Emotion Recognition via Valence-Arousal Pseudo-Label Refinement. Electronics, 15(10), 2213. https://doi.org/10.3390/electronics15102213

Vancouver

Kim S, Seo H, Jo IH, Lee EC. Semi-Supervised Facial Emotion Recognition via Valence-Arousal Pseudo-Label Refinement. Electronics. 2026;15(10):2213. doi:10.3390/electronics15102213

BibTeX
@article{Kim2026,
  author = {Kim, Seunghyun and Seo, Hyunsoo and Jo, Ill Hyung and Lee, Eui Chul},
  title = {Semi-Supervised Facial Emotion Recognition via Valence-Arousal Pseudo-Label Refinement},
  journal = {Electronics},
  year = {2026},
  volume = {15},
  number = {10},
  pages = {2213},
  doi = {10.3390/electronics15102213}
}
Kostenlos starten →