Dual-View Whitening on Pre-trained Text Embeddings for Sequential Recommendation
Proceedings of the AAAI Conference on Artificial Intelligence · 24.03.2024 · 38 (8) · 9332-9340
DOI: 10.1609/aaai.v38i8.28786 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 24.03.2024. Verfasst von Lingzi Zhang und 3 weiteren Autor:innen. Die Arbeit wurde bisher 14-mal zitiert (Crossref).
Abstract (Originalsprache)
Recent advances in sequential recommendation models have demonstrated the efficacy of integrating pre-trained text embeddings with item ID embeddings to achieve superior performance. However, our study takes a unique perspective by exclusively focusing on the untapped potential of text embeddings, obviating the need for ID embeddings. We begin by implementing a pre-processing strategy known as whitening, which effectively transforms the anisotropic semantic space of pre-trained text embeddings into an isotropic Gaussian distribution. Comprehensive experiments reveal that applying whitening to pre-trained text embeddings in sequential recommendation models significantly enhances performance. Yet, a full whitening operation might break the potential manifold of items with similar text semantics. To retain the original semantics while benefiting from the isotropy of the whitened text features, we propose a Dual-view Whitening method for Sequential Recommendation (DWSRec), which leverages both fully whitened and relaxed whitened item representations as dual views for effective recommendations. We further examine the advantages of our approach through both empirical and theoretical analyses. Experiments on three public benchmark datasets show that DWSRec outperforms state-of-the-art methods for sequential recommendation.
Zitieren
APA
Zhang, L., Zhou, X., Zeng, Z., & Shen, Z. (2024). Dual-View Whitening on Pre-trained Text Embeddings for Sequential Recommendation. Proceedings of the AAAI Conference on Artificial Intelligence, 38(8), 9332-9340. https://doi.org/10.1609/aaai.v38i8.28786
Vancouver
Zhang L, Zhou X, Zeng Z, Shen Z. Dual-View Whitening on Pre-trained Text Embeddings for Sequential Recommendation. Proceedings of the AAAI Conference on Artificial Intelligence. 2024;38(8):9332-9340. doi:10.1609/aaai.v38i8.28786
BibTeX
@article{Zhang2024,
author = {Zhang, Lingzi and Zhou, Xin and Zeng, Zhiwei and Shen, Zhiqi},
title = {Dual-View Whitening on Pre-trained Text Embeddings for Sequential Recommendation},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
year = {2024},
volume = {38},
number = {8},
pages = {9332--9340},
doi = {10.1609/aaai.v38i8.28786}
}
EUVIMED