S³-MSD: Large Vision-Language Model for Explainable and Generalizable Multi-modal Sarcasm Detection
Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (41) · 35266-35274
DOI: 10.1609/aaai.v40i41.40834 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Zhihong Zhu und 8 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref).
Abstract (Originalsprache)
Multimodal sarcasm detection (MSD) aims to identify sarcasm polarity from diverse modalities (i.e., image–text pairs), a task that has received increasing attention. While significant progress has been made, existing approaches still face two major issues: lack of explainability and weak generalizability. In this paper, we introduce a new large vision–language model (LVLM) dubbed S³-MSD for explainable and generalizable MSD through three key components. For explainability, we develop (1) a self-training paradigm that automatically bootstraps answers with explanations, and (2) a self-calibrating mechanism that rectifies flawed explanations. For generalizability, we design (3) a self-focusing module that amplifies visual semantic entities through preference optimization, thereby mitigating textual over-reliance. Experimental results on both in-distribution and out-of-distribution (OOD) benchmarks demonstrate that S³-MSD consistently outperforms state-of-the-art methods in detection performance. Furthermore, the proposed S³-MSD provides persuasive explanations, as verified by both quantitative metrics and human evaluations.
Zitieren
APA
Zhu, Z., Zhang, F., Zhang, Y., Sun, J., Hu, G., Wu, H., Chen, Y., Xing, B., & Wu, X. (2026). S³-MSD: Large Vision-Language Model for Explainable and Generalizable Multi-modal Sarcasm Detection. Proceedings of the AAAI Conference on Artificial Intelligence, 40(41), 35266-35274. https://doi.org/10.1609/aaai.v40i41.40834
Vancouver
Zhu Z, Zhang F, Zhang Y, Sun J, Hu G, Wu H, et al. S³-MSD: Large Vision-Language Model for Explainable and Generalizable Multi-modal Sarcasm Detection. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(41):35266-35274. doi:10.1609/aaai.v40i41.40834
BibTeX
@article{Zhu2026,
author = {Zhu, Zhihong and Zhang, Fan and Zhang, Yunyan and Sun, Jinghan and Hu, Guimin and Wu, Hao and Chen, Yuyan and Xing, Bowen and Wu, Xian},
title = {S³-MSD: Large Vision-Language Model for Explainable and Generalizable Multi-modal Sarcasm Detection},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
year = {2026},
volume = {40},
number = {41},
pages = {35266--35274},
doi = {10.1609/aaai.v40i41.40834}
}
EUVIMED