Improving Multimodal Social Media Popularity Prediction via Selective Retrieval Knowledge Augmentation
Proceedings of the AAAI Conference on Artificial Intelligence · 11.04.2025 · 39 (1) · 932-940
DOI: 10.1609/aaai.v39i1.32078 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 11.04.2025. Verfasst von Xovee Xu und 3 weiteren Autor:innen. Die Arbeit wurde bisher 19-mal zitiert (Crossref).
Abstract (Originalsprache)
Understanding and predicting the popularity of online User-Generated Content (UGC) is critical for various social and recommendation systems. Existing efforts have focused on extracting predictive features and using pre-trained deep models to learn and fuse multimodal UGC representations. However, the dissemination of social UGCs is not an isolated process in social network; rather, it is influenced by contextual relevant UGCs and various exogenous factors, including social ties, trends, user interests, and platform algorithms. In this work, we propose a retrieval-based framework to enhance the popularity prediction of multimodal UGCs. Our framework extends beyond a simple semantic retrieval, incorporating a meta retrieval strategy that queries a diverse set of relevant UGCs by considering multimodal content semantics, and metadata from user and post. Moreover, to eliminate irrelevant and noisy UGCs in retrieval, we introduce a new measure called Relative Retrieval Contribution to Prediction (RRCP), which selectively refines the retrieved UGCs. We then aggregate the contextual UGC knowledge using vision-language graph neural networks, and fuse them with an RRCP-Attention-based prediction network. Extensive experiments on three large-scale social media datasets demonstrate significant improvements ranging from 26.68% to 48.19% across all metrics compared to strong baselines.
Zitieren
APA
Xu, X., Zhang, Y., Zhou, F., & Song, J. (2025). Improving Multimodal Social Media Popularity Prediction via Selective Retrieval Knowledge Augmentation. Proceedings of the AAAI Conference on Artificial Intelligence, 39(1), 932-940. https://doi.org/10.1609/aaai.v39i1.32078
Vancouver
Xu X, Zhang Y, Zhou F, Song J. Improving Multimodal Social Media Popularity Prediction via Selective Retrieval Knowledge Augmentation. Proceedings of the AAAI Conference on Artificial Intelligence. 2025;39(1):932-940. doi:10.1609/aaai.v39i1.32078
BibTeX
@article{Xu2025,
author = {Xu, Xovee and Zhang, Yifan and Zhou, Fan and Song, Jingkuan},
title = {Improving Multimodal Social Media Popularity Prediction via Selective Retrieval Knowledge Augmentation},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
year = {2025},
volume = {39},
number = {1},
pages = {932--940},
doi = {10.1609/aaai.v39i1.32078}
}
EUVIMED