MemeCLIP: Leveraging Contrastive Language-Image Pre-training (CLIP) for Memotion Analysis
Journal of Communications Software and Systems · 2026 · 22 (2) · 232-243
DOI: 10.24138/jcomss-2025-0150 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Communications Software and Systems, 2026. Verfasst von Vaishali Ganganwar und 4 weiteren Autor:innen.
Abstract (Originalsprache)
Nowadays, memes, which commonly spread humor, ideas, or even harmful materials such as hate and propaganda, are a significant part of the Internet culture. The meme consists of an image and supporting text. Memotion Analysis, or meme Emotion Analysis, is automatic processing of memes using artificial intelligence. Unimodal solutions are now being taken over by multimodal solutions such as feature concatenation, weighted fusion, and Gated Multimodal Unit(GMU)for better Memotion Analysis. In this work, we proposed two deep learning based multimodal models for meme emotion classification. In the first model, we used ResNet and DeBERTa separately for single image-text fusion. In the second ‘MemeCLIP’ model an integrated CLIP-based representation with GMU employing a gated mechanism for adaptive visual and text feature fusion is used. In contrast to simple concatenation techniques, GMU demonstrates superior capability in extracting fine-grained emo tional cues embedded in Memes. For the Memotion Analysis task 8 of SemEval-2020 competition, the CLIP-based model ‘MemeCLIP’ achieved a F1-score of 0.65, closely followed by the ResNet+DeBERTa model with a score of 0.64, compared to the SemEval baseline of 0.5118. These findings demonstrate the strength of selectively regulating modality contributions.
Zitieren
APA
Ganganwar, V., Chauhan, G. S., Singh, J., Khajuria, S., & Battan, V. (2026). MemeCLIP: Leveraging Contrastive Language-Image Pre-training (CLIP) for Memotion Analysis. Journal of Communications Software and Systems, 22(2), 232-243. https://doi.org/10.24138/jcomss-2025-0150
Vancouver
Ganganwar V, Chauhan GS, Singh J, Khajuria S, Battan V. MemeCLIP: Leveraging Contrastive Language-Image Pre-training (CLIP) for Memotion Analysis. Journal of Communications Software and Systems. 2026;22(2):232-243. doi:10.24138/jcomss-2025-0150
BibTeX
@article{Ganganwar2026,
author = {Ganganwar, Vaishali and Chauhan, Gaurav Singh and Singh, Jangveer and Khajuria, Shashvat and Battan, Vivek},
title = {MemeCLIP: Leveraging Contrastive Language-Image Pre-training (CLIP) for Memotion Analysis},
journal = {Journal of Communications Software and Systems},
year = {2026},
volume = {22},
number = {2},
pages = {232--243},
doi = {10.24138/jcomss-2025-0150}
}
EUVIMED