EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Fine-Grained Pose-Aware Visual Fusion for Emotion Recognition in Conversational Video Streams

Constantin Bogdan Popescu, Corneliu Florea

Mathematics · 20.07.2026 · 14 (14) · 2639

DOI: 10.3390/math14142639 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Mathematics, online erschienen am 20.07.2026. Verfasst von Constantin Bogdan Popescu und 1 weiteren Autor:innen. Die Arbeit nennt 37 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Despite the rapid advancement of Emotion Recognition in Conversation (ERC), prevailing systems that primarily integrate language and speech exhibit substantial performance disparities on underrepresented emotion classes (e.g., Fear, Disgust). This study investigates whether fine-grained non-verbal visual modalities (facial action units, hand gestures, and body pose) can effectively mitigate these biases. We propose a multi-stream fusion architecture combining language, speech, and engineered pose-aware visual features, trained with class-imbalance-aware objectives. Experiments on MELD demonstrate that hybrid pose augmentation improves F1 on the least frequent classes: Fear +9.19%, Disgust +6.07%, Sadness +6.46%. We achieve an overall weighted F1 of 68.79%, competitive with recent state-of-the-art systems while uniquely targeting minority-class debiasing. These results establish fine-grained body language as a critical debiasing signal, recovering accuracy on the subtle expressions that text and speech alone fail to capture.

Zitieren

APA

Popescu, C. B., & Florea, C. (2026). Fine-Grained Pose-Aware Visual Fusion for Emotion Recognition in Conversational Video Streams. Mathematics, 14(14), 2639. https://doi.org/10.3390/math14142639

Vancouver

Popescu CB, Florea C. Fine-Grained Pose-Aware Visual Fusion for Emotion Recognition in Conversational Video Streams. Mathematics. 2026;14(14):2639. doi:10.3390/math14142639

BibTeX
@article{Popescu2026,
  author = {Popescu, Constantin Bogdan and Florea, Corneliu},
  title = {Fine-Grained Pose-Aware Visual Fusion for Emotion Recognition in Conversational Video Streams},
  journal = {Mathematics},
  year = {2026},
  volume = {14},
  number = {14},
  pages = {2639},
  doi = {10.3390/math14142639}
}
Kostenlos starten →