Improving Transformer-based Sequential Recommenders through Preference Editing
ACM Transactions on Information Systems · 2023-07-31 · 41 (3) · 1-24
DOI: 10.1145/3564282 ↗At a glance
Journal article in ACM Transactions on Information Systems, published online on 2023-04-10. Written by Muyang Ma and 6 co-authors. Cited 29 times so far (Crossref); 83 references. Funded by: National Key R&D Program of China, Natural Science Foundation of China, Key Scientific and Technological Innovation Program of Shandong Province.
Abstract (original language)
One of the key challenges in sequential recommendation is how to extract and represent user preferences. Traditional methods rely solely on predicting the next item. But user behavior may be driven by complex preferences. Therefore, these methods cannot make accurate recommendations when the available information user behavior is limited. To explore multiple user preferences, we propose a transformer-based sequential recommendation model, named MrTransformer ( M ulti-p r eference Transformer ). For training MrTransformer, we devise a preference-editing -based self-supervised learning (SSL) mechanism that explores extra supervision signals based on relations with other sequences. The idea is to force the sequential recommendation model to discriminate between common and unique preferences in different sequences of interactions. By doing so, the sequential recommendation model is able to disentangle user preferences into multiple independent preference representations so as to improve user preference extraction and representation. We carry out extensive experiments on five benchmark datasets. MrTransformer with preference editing significantly outperforms state-of-the-art sequential recommendation methods in terms of Recall, MRR, and NDCG. We find that long sequences of interactions from which user preferences are harder to extract and represent benefit most from preference editing.
Funding
- National Key R&D Program of China
- Natural Science Foundation of China
- Key Scientific and Technological Innovation Program of Shandong Province
- Natural Science Foundation of Shandong Province
- Tencent WeChat Rhino-Bird Focused Research Program
- Fundamental Research Funds of Shandong University
- Hybrid Intelligence Center
- Dutch Ministry of Education, Culture and Science through the Netherlands Organisation for Scientific Research
Cite
APA
Ma, M., Ren, P., Chen, Z., Ren, Z., Liang, H., Ma, J., & Rijke, M. D. (2023). Improving Transformer-based Sequential Recommenders through Preference Editing. ACM Transactions on Information Systems, 41(3), 1-24. https://doi.org/10.1145/3564282
Vancouver
Ma M, Ren P, Chen Z, Ren Z, Liang H, Ma J, et al. Improving Transformer-based Sequential Recommenders through Preference Editing. ACM Transactions on Information Systems. 2023;41(3):1-24. doi:10.1145/3564282
BibTeX
@article{Ma2023,
author = {Ma, Muyang and Ren, Pengjie and Chen, Zhumin and Ren, Zhaochun and Liang, Huasheng and Ma, Jun and Rijke, Maarten De},
title = {Improving Transformer-based Sequential Recommenders through Preference Editing},
journal = {ACM Transactions on Information Systems},
year = {2023},
volume = {41},
number = {3},
pages = {1--24},
doi = {10.1145/3564282}
}
EUVIMED