EUVIMEDEUVIMED entdecken
Crossref

Dual-View Whitening on Pre-trained Text Embeddings for Sequential Recommendation

Lingzi Zhang, Xin Zhou, Zhiwei Zeng, Zhiqi Shen

Proceedings of the AAAI Conference on Artificial Intelligence · 24.03.2024 · 38 (8) · 9332-9340

DOI: 10.1609/aaai.v38i8.28786 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 24.03.2024. Verfasst von Lingzi Zhang und 3 weiteren Autor:innen. Die Arbeit wurde bisher 14-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Recent advances in sequential recommendation models have demonstrated the efficacy of integrating pre-trained text embeddings with item ID embeddings to achieve superior performance. However, our study takes a unique perspective by exclusively focusing on the untapped potential of text embeddings, obviating the need for ID embeddings. We begin by implementing a pre-processing strategy known as whitening, which effectively transforms the anisotropic semantic space of pre-trained text embeddings into an isotropic Gaussian distribution. Comprehensive experiments reveal that applying whitening to pre-trained text embeddings in sequential recommendation models significantly enhances performance. Yet, a full whitening operation might break the potential manifold of items with similar text semantics. To retain the original semantics while benefiting from the isotropy of the whitened text features, we propose a Dual-view Whitening method for Sequential Recommendation (DWSRec), which leverages both fully whitened and relaxed whitened item representations as dual views for effective recommendations. We further examine the advantages of our approach through both empirical and theoretical analyses. Experiments on three public benchmark datasets show that DWSRec outperforms state-of-the-art methods for sequential recommendation.

Zitieren

APA

Zhang, L., Zhou, X., Zeng, Z., & Shen, Z. (2024). Dual-View Whitening on Pre-trained Text Embeddings for Sequential Recommendation. Proceedings of the AAAI Conference on Artificial Intelligence, 38(8), 9332-9340. https://doi.org/10.1609/aaai.v38i8.28786

Vancouver

Zhang L, Zhou X, Zeng Z, Shen Z. Dual-View Whitening on Pre-trained Text Embeddings for Sequential Recommendation. Proceedings of the AAAI Conference on Artificial Intelligence. 2024;38(8):9332-9340. doi:10.1609/aaai.v38i8.28786

BibTeX
@article{Zhang2024,
  author = {Zhang, Lingzi and Zhou, Xin and Zeng, Zhiwei and Shen, Zhiqi},
  title = {Dual-View Whitening on Pre-trained Text Embeddings for Sequential Recommendation},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2024},
  volume = {38},
  number = {8},
  pages = {9332--9340},
  doi = {10.1609/aaai.v38i8.28786}
}
Kostenlos starten →