Improving Transformer-based Sequential Recommenders through Preference Editing
ACM Transactions on Information Systems · 31.07.2023 · 41 (3) · 1-24
DOI: 10.1145/3564282 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Information Systems, online erschienen am 10.04.2023. Verfasst von Muyang Ma und 6 weiteren Autor:innen. Die Arbeit wurde bisher 29-mal zitiert (Crossref) und nennt 83 Literaturangaben. Gefördert von: National Key R&D Program of China, Natural Science Foundation of China, Key Scientific and Technological Innovation Program of Shandong Province.
Abstract (Originalsprache)
One of the key challenges in sequential recommendation is how to extract and represent user preferences. Traditional methods rely solely on predicting the next item. But user behavior may be driven by complex preferences. Therefore, these methods cannot make accurate recommendations when the available information user behavior is limited. To explore multiple user preferences, we propose a transformer-based sequential recommendation model, named MrTransformer ( M ulti-p r eference Transformer ). For training MrTransformer, we devise a preference-editing -based self-supervised learning (SSL) mechanism that explores extra supervision signals based on relations with other sequences. The idea is to force the sequential recommendation model to discriminate between common and unique preferences in different sequences of interactions. By doing so, the sequential recommendation model is able to disentangle user preferences into multiple independent preference representations so as to improve user preference extraction and representation. We carry out extensive experiments on five benchmark datasets. MrTransformer with preference editing significantly outperforms state-of-the-art sequential recommendation methods in terms of Recall, MRR, and NDCG. We find that long sequences of interactions from which user preferences are harder to extract and represent benefit most from preference editing.
Förderung
- National Key R&D Program of China
- Natural Science Foundation of China
- Key Scientific and Technological Innovation Program of Shandong Province
- Natural Science Foundation of Shandong Province
- Tencent WeChat Rhino-Bird Focused Research Program
- Fundamental Research Funds of Shandong University
- Hybrid Intelligence Center
- Dutch Ministry of Education, Culture and Science through the Netherlands Organisation for Scientific Research
Zitieren
APA
Ma, M., Ren, P., Chen, Z., Ren, Z., Liang, H., Ma, J., & Rijke, M. D. (2023). Improving Transformer-based Sequential Recommenders through Preference Editing. ACM Transactions on Information Systems, 41(3), 1-24. https://doi.org/10.1145/3564282
Vancouver
Ma M, Ren P, Chen Z, Ren Z, Liang H, Ma J, et al. Improving Transformer-based Sequential Recommenders through Preference Editing. ACM Transactions on Information Systems. 2023;41(3):1-24. doi:10.1145/3564282
BibTeX
@article{Ma2023,
author = {Ma, Muyang and Ren, Pengjie and Chen, Zhumin and Ren, Zhaochun and Liang, Huasheng and Ma, Jun and Rijke, Maarten De},
title = {Improving Transformer-based Sequential Recommenders through Preference Editing},
journal = {ACM Transactions on Information Systems},
year = {2023},
volume = {41},
number = {3},
pages = {1--24},
doi = {10.1145/3564282}
}
EUVIMED