Fine-Grained Pose-Aware Visual Fusion for Emotion Recognition in Conversational Video Streams
Mathematics · 20.07.2026 · 14 (14) · 2639
DOI: 10.3390/math14142639 ↗Kurz gefasst
Fachartikel in der Zeitschrift Mathematics, online erschienen am 20.07.2026. Verfasst von Constantin Bogdan Popescu und 1 weiteren Autor:innen. Die Arbeit nennt 37 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Despite the rapid advancement of Emotion Recognition in Conversation (ERC), prevailing systems that primarily integrate language and speech exhibit substantial performance disparities on underrepresented emotion classes (e.g., Fear, Disgust). This study investigates whether fine-grained non-verbal visual modalities (facial action units, hand gestures, and body pose) can effectively mitigate these biases. We propose a multi-stream fusion architecture combining language, speech, and engineered pose-aware visual features, trained with class-imbalance-aware objectives. Experiments on MELD demonstrate that hybrid pose augmentation improves F1 on the least frequent classes: Fear +9.19%, Disgust +6.07%, Sadness +6.46%. We achieve an overall weighted F1 of 68.79%, competitive with recent state-of-the-art systems while uniquely targeting minority-class debiasing. These results establish fine-grained body language as a critical debiasing signal, recovering accuracy on the subtle expressions that text and speech alone fail to capture.
Zitieren
APA
Popescu, C. B., & Florea, C. (2026). Fine-Grained Pose-Aware Visual Fusion for Emotion Recognition in Conversational Video Streams. Mathematics, 14(14), 2639. https://doi.org/10.3390/math14142639
Vancouver
Popescu CB, Florea C. Fine-Grained Pose-Aware Visual Fusion for Emotion Recognition in Conversational Video Streams. Mathematics. 2026;14(14):2639. doi:10.3390/math14142639
BibTeX
@article{Popescu2026,
author = {Popescu, Constantin Bogdan and Florea, Corneliu},
title = {Fine-Grained Pose-Aware Visual Fusion for Emotion Recognition in Conversational Video Streams},
journal = {Mathematics},
year = {2026},
volume = {14},
number = {14},
pages = {2639},
doi = {10.3390/math14142639}
}
EUVIMED