DeepMSD: Advancing Multimodal Sarcasm Detection Through Knowledge-Augmented Graph Reasoning
IEEE Transactions on Circuits and Systems for Video Technology · 2025-07 · 35 (7) · 6413-6423
DOI: 10.1109/tcsvt.2025.3530436 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2025-07. Verfasst von Yiwei Wei und 7 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 45 Literaturangaben. Gefördert von: Youth Science Fund of the Natural Science Foundation of the Autonomous Region, National Natural Science Foundation of China.
Abstract (Originalsprache)
Multimodal sarcasm detection (MSD) requires predicting the sarcastic sentiment by understanding diverse modalities of data (e.g., text, image). Beyond the surface-level information conveyed in the post data, understanding the underlying deep-level knowledge-such as the background and intent behind the data-is crucial for understanding the sarcastic sentiment. However, previous works have often overlooked this aspect, limiting their potential to achieve superior performance. To tackle this challenge, we propose DeepMSD, a novel framework that generates supplemental deep-level knowledge to enhance the understanding of sarcastic content. Specifically, we first devise a Deep-level Knowledge Extraction Module that leverages large vision-language models to generate deep-level information behind the text-image pairs. Additionally, we devise a Cross-knowledge Graph Reasoning Module to model how humans use prior knowledge to identify sarcastic cues in multimodal posts. This module constructs cross-knowledge graphs that connect deep-level knowledge with surface-level knowledge. As such, it enables a more profound exploration of the cues underlying sarcasm. Experiments on the public MSD dataset demonstrate that our approach significantly surpasses previous state-of-the-art methods.
Förderung
- Youth Science Fund of the Natural Science Foundation of the Autonomous Region
- National Natural Science Foundation of China
Zitieren
APA
Wei, Y., Zhou, H., Yuan, S., Chen, M., Shi, H., Jia, Z., Wang, L., & He, X. (2025). DeepMSD: Advancing Multimodal Sarcasm Detection Through Knowledge-Augmented Graph Reasoning. IEEE Transactions on Circuits and Systems for Video Technology, 35(7), 6413-6423. https://doi.org/10.1109/tcsvt.2025.3530436
Vancouver
Wei Y, Zhou H, Yuan S, Chen M, Shi H, Jia Z, et al. DeepMSD: Advancing Multimodal Sarcasm Detection Through Knowledge-Augmented Graph Reasoning. IEEE Transactions on Circuits and Systems for Video Technology. 2025;35(7):6413-6423. doi:10.1109/tcsvt.2025.3530436
BibTeX
@article{Wei2025,
author = {Wei, Yiwei and Zhou, Hengyang and Yuan, Shaozu and Chen, Meng and Shi, Haitao and Jia, Zhiyang and Wang, Longbiao and He, Xiaodong},
title = {DeepMSD: Advancing Multimodal Sarcasm Detection Through Knowledge-Augmented Graph Reasoning},
journal = {IEEE Transactions on Circuits and Systems for Video Technology},
year = {2025},
volume = {35},
number = {7},
pages = {6413--6423},
doi = {10.1109/tcsvt.2025.3530436}
}
EUVIMED