Building Prototype Evolution Pathway for Emotion Recognition in User-Generated Videos
Big Data and Cognitive Computing · 28.02.2026 · 10 (3) · 73
DOI: 10.3390/bdcc10030073 ↗Kurz gefasst
Fachartikel in der Zeitschrift Big Data and Cognitive Computing, online erschienen am 28.02.2026. Verfasst von Yujie Liu und 3 weiteren Autor:innen. Die Arbeit nennt 42 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Research Council of Finland, EU HORIZON-MSCA-SE-2022 project ACMod.
Abstract (Originalsprache)
Large-scale pretrained foundation models are increasingly essential for affective analysis in user-generated videos. However, current approaches typically reuse generic multi-modal representations directly with task-specific adapters learned from scratch, and their performance is limited by the large affective domain gap and scarce emotion annotations. To address these issues, we introduce a novel paradigm that leverages auxiliary cross-modal priors to enhance unimodal emotion modeling, effectively exploiting modality-shared semantics and modality-specific inductive biases. Specifically, we propose a progressive prototype evolution framework that gradually transforms a neutral prototype into discriminative emotional representations through fine-grained cross-modal interactions with visual cues. The auxiliary prior serves as a structural constraint, reframing the adaptation challenge from a difficult domain shift problem into a more tractable prototype shift within the affective space. To ensure robust prototype construction and guided evolution, we further design category-aggregated prompting and bidirectional supervision mechanisms. Extensive experiments on VideoEmotion-8, Ekman-6, and MusicVideo-6 validate the superiority of our approach, achieving state-of-the-art results and demonstrating the effectiveness of leveraging auxiliary modality priors for foundation-model-based emotion recognition.
Förderung
- Research Council of Finland
- EU HORIZON-MSCA-SE-2022 project ACMod
Zitieren
APA
Liu, Y., Dong, Z., Li, Y., & Zhao, G. (2026). Building Prototype Evolution Pathway for Emotion Recognition in User-Generated Videos. Big Data and Cognitive Computing, 10(3), 73. https://doi.org/10.3390/bdcc10030073
Vancouver
Liu Y, Dong Z, Li Y, Zhao G. Building Prototype Evolution Pathway for Emotion Recognition in User-Generated Videos. Big Data and Cognitive Computing. 2026;10(3):73. doi:10.3390/bdcc10030073
BibTeX
@article{Liu2026,
author = {Liu, Yujie and Dong, Zhenyang and Li, Yante and Zhao, Guoying},
title = {Building Prototype Evolution Pathway for Emotion Recognition in User-Generated Videos},
journal = {Big Data and Cognitive Computing},
year = {2026},
volume = {10},
number = {3},
pages = {73},
doi = {10.3390/bdcc10030073}
}
EUVIMED