EUVIMEDEUVIMED entdecken
Crossref

DeepMSD: Advancing Multimodal Sarcasm Detection Through Knowledge-Augmented Graph Reasoning

Yiwei Wei, Hengyang Zhou, Shaozu Yuan, Meng Chen, Haitao Shi, Zhiyang Jia, Longbiao Wang, Xiaodong He

IEEE Transactions on Circuits and Systems for Video Technology · 2025-07 · 35 (7) · 6413-6423

DOI: 10.1109/tcsvt.2025.3530436 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2025-07. Verfasst von Yiwei Wei und 7 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 45 Literaturangaben. Gefördert von: Youth Science Fund of the Natural Science Foundation of the Autonomous Region, National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multimodal sarcasm detection (MSD) requires predicting the sarcastic sentiment by understanding diverse modalities of data (e.g., text, image). Beyond the surface-level information conveyed in the post data, understanding the underlying deep-level knowledge-such as the background and intent behind the data-is crucial for understanding the sarcastic sentiment. However, previous works have often overlooked this aspect, limiting their potential to achieve superior performance. To tackle this challenge, we propose DeepMSD, a novel framework that generates supplemental deep-level knowledge to enhance the understanding of sarcastic content. Specifically, we first devise a Deep-level Knowledge Extraction Module that leverages large vision-language models to generate deep-level information behind the text-image pairs. Additionally, we devise a Cross-knowledge Graph Reasoning Module to model how humans use prior knowledge to identify sarcastic cues in multimodal posts. This module constructs cross-knowledge graphs that connect deep-level knowledge with surface-level knowledge. As such, it enables a more profound exploration of the cues underlying sarcasm. Experiments on the public MSD dataset demonstrate that our approach significantly surpasses previous state-of-the-art methods.

Förderung

  • Youth Science Fund of the Natural Science Foundation of the Autonomous Region
  • National Natural Science Foundation of China

Zitieren

APA

Wei, Y., Zhou, H., Yuan, S., Chen, M., Shi, H., Jia, Z., Wang, L., & He, X. (2025). DeepMSD: Advancing Multimodal Sarcasm Detection Through Knowledge-Augmented Graph Reasoning. IEEE Transactions on Circuits and Systems for Video Technology, 35(7), 6413-6423. https://doi.org/10.1109/tcsvt.2025.3530436

Vancouver

Wei Y, Zhou H, Yuan S, Chen M, Shi H, Jia Z, et al. DeepMSD: Advancing Multimodal Sarcasm Detection Through Knowledge-Augmented Graph Reasoning. IEEE Transactions on Circuits and Systems for Video Technology. 2025;35(7):6413-6423. doi:10.1109/tcsvt.2025.3530436

BibTeX
@article{Wei2025,
  author = {Wei, Yiwei and Zhou, Hengyang and Yuan, Shaozu and Chen, Meng and Shi, Haitao and Jia, Zhiyang and Wang, Longbiao and He, Xiaodong},
  title = {DeepMSD: Advancing Multimodal Sarcasm Detection Through Knowledge-Augmented Graph Reasoning},
  journal = {IEEE Transactions on Circuits and Systems for Video Technology},
  year = {2025},
  volume = {35},
  number = {7},
  pages = {6413--6423},
  doi = {10.1109/tcsvt.2025.3530436}
}
Kostenlos starten →