EUVIMEDEUVIMED entdecken
Crossref

S³-MSD: Large Vision-Language Model for Explainable and Generalizable Multi-modal Sarcasm Detection

Zhihong Zhu, Fan Zhang, Yunyan Zhang, Jinghan Sun, Guimin Hu, Hao Wu, Yuyan Chen, Bowen Xing, Xian Wu

Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (41) · 35266-35274

DOI: 10.1609/aaai.v40i41.40834 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Zhihong Zhu und 8 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multimodal sarcasm detection (MSD) aims to identify sarcasm polarity from diverse modalities (i.e., image–text pairs), a task that has received increasing attention. While significant progress has been made, existing approaches still face two major issues: lack of explainability and weak generalizability. In this paper, we introduce a new large vision–language model (LVLM) dubbed S³-MSD for explainable and generalizable MSD through three key components. For explainability, we develop (1) a self-training paradigm that automatically bootstraps answers with explanations, and (2) a self-calibrating mechanism that rectifies flawed explanations. For generalizability, we design (3) a self-focusing module that amplifies visual semantic entities through preference optimization, thereby mitigating textual over-reliance. Experimental results on both in-distribution and out-of-distribution (OOD) benchmarks demonstrate that S³-MSD consistently outperforms state-of-the-art methods in detection performance. Furthermore, the proposed S³-MSD provides persuasive explanations, as verified by both quantitative metrics and human evaluations.

Zitieren

APA

Zhu, Z., Zhang, F., Zhang, Y., Sun, J., Hu, G., Wu, H., Chen, Y., Xing, B., & Wu, X. (2026). S³-MSD: Large Vision-Language Model for Explainable and Generalizable Multi-modal Sarcasm Detection. Proceedings of the AAAI Conference on Artificial Intelligence, 40(41), 35266-35274. https://doi.org/10.1609/aaai.v40i41.40834

Vancouver

Zhu Z, Zhang F, Zhang Y, Sun J, Hu G, Wu H, et al. S³-MSD: Large Vision-Language Model for Explainable and Generalizable Multi-modal Sarcasm Detection. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(41):35266-35274. doi:10.1609/aaai.v40i41.40834

BibTeX
@article{Zhu2026,
  author = {Zhu, Zhihong and Zhang, Fan and Zhang, Yunyan and Sun, Jinghan and Hu, Guimin and Wu, Hao and Chen, Yuyan and Xing, Bowen and Wu, Xian},
  title = {S³-MSD: Large Vision-Language Model for Explainable and Generalizable Multi-modal Sarcasm Detection},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2026},
  volume = {40},
  number = {41},
  pages = {35266--35274},
  doi = {10.1609/aaai.v40i41.40834}
}
Kostenlos starten →