Semi-Supervised Facial Emotion Recognition via Valence-Arousal Pseudo-Label Refinement
Electronics · 21.05.2026 · 15 (10) · 2213
DOI: 10.3390/electronics15102213 ↗Kurz gefasst
Fachartikel in der Zeitschrift Electronics, online erschienen am 21.05.2026. Verfasst von Seunghyun Kim und 3 weiteren Autor:innen. Die Arbeit nennt 24 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministry of Education of the Republic of Korea, National Research Foundation of Korea.
Abstract (Originalsprache)
Facial expression recognition is a pivotal area in computer vision, traditionally focusing on categorical labels such as ‘Happy’, and ‘Sad’. Recent advancements have transitioned towards using the continuous indicators valence and arousal, reflecting the complicated nature of human emotions. This study introduces a method using semi-supervised learning to generate valence and arousal labels for existing categorical datasets, addressing challenges like racial bias. We propose a pseudo-label refinement framework, VAP-Refine (Valence-Arousal Pseudo-label Refinement), which enhances facial expression recognition by combining teacher model predictions and category-level statistics. These predicted labels are adjusted using ground truth category information and combined with actual category labels to train a more robust facial expression recognition model. Our approach improved accuracy from 69.3% to 72.26% and from 62.94% to 67.24% across two datasets. Fine-tuning with a teacher model predicting valence and arousal achieved 75.82% and 91.58% accuracy, with an F1-score of 0.9147, despite data imbalances. These results highlight the potential of semi-supervised learning to enhance facial expression recognition by incorporating continuous emotional indicators, improving model performance and contributing to more accurate affective computing applications. Furthermore, the proposed framework consistently improved performance across various backbone architectures, including ResNet50, SHViT, and DDAMFN++, highlighting its generalizability and versatility.
Förderung
- Ministry of Education of the Republic of Korea
- National Research Foundation of Korea
Zitieren
APA
Kim, S., Seo, H., Jo, I. H., & Lee, E. C. (2026). Semi-Supervised Facial Emotion Recognition via Valence-Arousal Pseudo-Label Refinement. Electronics, 15(10), 2213. https://doi.org/10.3390/electronics15102213
Vancouver
Kim S, Seo H, Jo IH, Lee EC. Semi-Supervised Facial Emotion Recognition via Valence-Arousal Pseudo-Label Refinement. Electronics. 2026;15(10):2213. doi:10.3390/electronics15102213
BibTeX
@article{Kim2026,
author = {Kim, Seunghyun and Seo, Hyunsoo and Jo, Ill Hyung and Lee, Eui Chul},
title = {Semi-Supervised Facial Emotion Recognition via Valence-Arousal Pseudo-Label Refinement},
journal = {Electronics},
year = {2026},
volume = {15},
number = {10},
pages = {2213},
doi = {10.3390/electronics15102213}
}
EUVIMED