Emotion Recognition of Images Based on Label Enhancement for Consumer Electronics Applications
IEEE Transactions on Consumer Electronics · 2025-02 · 71 (1) · 427-437
DOI: 10.1109/tce.2024.3496909 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Consumer Electronics, 2025-02. Verfasst von Xin Wang und 4 weiteren Autor:innen. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 52 Literaturangaben. Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China, Fundamental Research Funds for the Central Universities.
Abstract (Originalsprache)
Consumer electronics have gained widespread popularity and generated massive data, such as text, speech, and images. Different from other modalities, images have richer semantics, among which emotion is one of the most interesting characteristics, which can empower various consumer electronics applications, such as depression diagnosis, health monitoring, and recommendation. Generally, images, especially those generated by consumer electronics (i.e., smartphone) in real-world scenes, have blended emotions. Literature has proposed to capture the blended emotions with emotion distribution that covers all emotions with different relevance. However, images are generally annotated with logical labels without emotion distribution. In this paper, we apply the label enhancement (LE) technique to emotion recognition of images. We design a novel LE algorithm by exploiting label manifold (LELM) to enhance the logical labels into emotion distributions. After obtaining the emotion distributions, we train a deep neural network with KL-divergence and margin loss to learn such emotion distributions. Finally, we conduct experiments on four large-scale image datasets. The experimental results justify that our method achieves the best results for enhancing emotion distributions and highest accuracy for emotion prediction.
Förderung
- National Key Research and Development Program of China
- National Natural Science Foundation of China
- Fundamental Research Funds for the Central Universities
- Liaoning Provincial Science and Technology Joint Program
Zitieren
APA
Wang, X., Slowik, A., Yi, B., Manimurugan, S., & Liu, J. (2025). Emotion Recognition of Images Based on Label Enhancement for Consumer Electronics Applications. IEEE Transactions on Consumer Electronics, 71(1), 427-437. https://doi.org/10.1109/tce.2024.3496909
Vancouver
Wang X, Slowik A, Yi B, Manimurugan S, Liu J. Emotion Recognition of Images Based on Label Enhancement for Consumer Electronics Applications. IEEE Transactions on Consumer Electronics. 2025;71(1):427-437. doi:10.1109/tce.2024.3496909
BibTeX
@article{Wang2025,
author = {Wang, Xin and Slowik, Adam and Yi, Bo and Manimurugan, S. and Liu, Jinlei},
title = {Emotion Recognition of Images Based on Label Enhancement for Consumer Electronics Applications},
journal = {IEEE Transactions on Consumer Electronics},
year = {2025},
volume = {71},
number = {1},
pages = {427--437},
doi = {10.1109/tce.2024.3496909}
}
EUVIMED