EUVIMEDEUVIMED entdecken
Crossref

Causal-ERC: A Multimodal Framework with Causal Prompting for Emotion Recognition in Conversations with Large Language Models

Ran Jing, Geng Tu, Yice Zhang, Ruifeng Xu

Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (37) · 31383-31391

DOI: 10.1609/aaai.v40i37.40402 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Ran Jing und 3 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The rapid advancement of large language models (LLMs) has revitalised research in Emotion Recognition in Conversation (ERC). However, existing LLM-based ERC approaches operate solely on textual input, whereas MLLM-based emotion recognition methods in non-conversational scenarios typically perform only basic multimodal fusion and fail to consider speaker-sensitive contextual dependencies, which limits their performance on ERC tasks. To integrate multimodal cues effectively and address their limitations in handling contextual dependencies, we propose a novel LLM-based framework, Causal-ERC, which captures context representations within each modality and incorporates them into the LLM. Moreover, experimental results show that LLMs perform poorly on long conversations. To improve LLMs' ability to model long conversations, we adjust corresponding causal prompts according to the causal type of each utterance. Experiments on two benchmark MERC datasets demonstrate that our Causal-ERC framework consistently outperforms existing state-of-the-art approaches and improves LLM's performance in long-context scenarios.

Zitieren

APA

Jing, R., Tu, G., Zhang, Y., & Xu, R. (2026). Causal-ERC: A Multimodal Framework with Causal Prompting for Emotion Recognition in Conversations with Large Language Models. Proceedings of the AAAI Conference on Artificial Intelligence, 40(37), 31383-31391. https://doi.org/10.1609/aaai.v40i37.40402

Vancouver

Jing R, Tu G, Zhang Y, Xu R. Causal-ERC: A Multimodal Framework with Causal Prompting for Emotion Recognition in Conversations with Large Language Models. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(37):31383-31391. doi:10.1609/aaai.v40i37.40402

BibTeX
@article{Jing2026,
  author = {Jing, Ran and Tu, Geng and Zhang, Yice and Xu, Ruifeng},
  title = {Causal-ERC: A Multimodal Framework with Causal Prompting for Emotion Recognition in Conversations with Large Language Models},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2026},
  volume = {40},
  number = {37},
  pages = {31383--31391},
  doi = {10.1609/aaai.v40i37.40402}
}
Kostenlos starten →