EUVIMEDEUVIMED entdecken
Crossref

Improving Multimodal Social Media Popularity Prediction via Selective Retrieval Knowledge Augmentation

Xovee Xu, Yifan Zhang, Fan Zhou, Jingkuan Song

Proceedings of the AAAI Conference on Artificial Intelligence · 11.04.2025 · 39 (1) · 932-940

DOI: 10.1609/aaai.v39i1.32078 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 11.04.2025. Verfasst von Xovee Xu und 3 weiteren Autor:innen. Die Arbeit wurde bisher 19-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Understanding and predicting the popularity of online User-Generated Content (UGC) is critical for various social and recommendation systems. Existing efforts have focused on extracting predictive features and using pre-trained deep models to learn and fuse multimodal UGC representations. However, the dissemination of social UGCs is not an isolated process in social network; rather, it is influenced by contextual relevant UGCs and various exogenous factors, including social ties, trends, user interests, and platform algorithms. In this work, we propose a retrieval-based framework to enhance the popularity prediction of multimodal UGCs. Our framework extends beyond a simple semantic retrieval, incorporating a meta retrieval strategy that queries a diverse set of relevant UGCs by considering multimodal content semantics, and metadata from user and post. Moreover, to eliminate irrelevant and noisy UGCs in retrieval, we introduce a new measure called Relative Retrieval Contribution to Prediction (RRCP), which selectively refines the retrieved UGCs. We then aggregate the contextual UGC knowledge using vision-language graph neural networks, and fuse them with an RRCP-Attention-based prediction network. Extensive experiments on three large-scale social media datasets demonstrate significant improvements ranging from 26.68% to 48.19% across all metrics compared to strong baselines.

Zitieren

APA

Xu, X., Zhang, Y., Zhou, F., & Song, J. (2025). Improving Multimodal Social Media Popularity Prediction via Selective Retrieval Knowledge Augmentation. Proceedings of the AAAI Conference on Artificial Intelligence, 39(1), 932-940. https://doi.org/10.1609/aaai.v39i1.32078

Vancouver

Xu X, Zhang Y, Zhou F, Song J. Improving Multimodal Social Media Popularity Prediction via Selective Retrieval Knowledge Augmentation. Proceedings of the AAAI Conference on Artificial Intelligence. 2025;39(1):932-940. doi:10.1609/aaai.v39i1.32078

BibTeX
@article{Xu2025,
  author = {Xu, Xovee and Zhang, Yifan and Zhou, Fan and Song, Jingkuan},
  title = {Improving Multimodal Social Media Popularity Prediction via Selective Retrieval Knowledge Augmentation},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2025},
  volume = {39},
  number = {1},
  pages = {932--940},
  doi = {10.1609/aaai.v39i1.32078}
}
Kostenlos starten →