EUVIMEDOpdag EUVIMED
Crossref

Improving Transformer-based Sequential Recommenders through Preference Editing

Muyang Ma, Pengjie Ren, Zhumin Chen, Zhaochun Ren, Huasheng Liang, Jun Ma, Maarten De Rijke

ACM Transactions on Information Systems · 2023-07-31 · 41 (3) · 1-24

DOI: 10.1145/3564282 ↗

At a glance

Journal article in ACM Transactions on Information Systems, published online on 2023-04-10. Written by Muyang Ma and 6 co-authors. Cited 29 times so far (Crossref); 83 references. Funded by: National Key R&D Program of China, Natural Science Foundation of China, Key Scientific and Technological Innovation Program of Shandong Province.

AbstractBibliografiske oplysningerCiteRelated studies

Abstract (original language)

One of the key challenges in sequential recommendation is how to extract and represent user preferences. Traditional methods rely solely on predicting the next item. But user behavior may be driven by complex preferences. Therefore, these methods cannot make accurate recommendations when the available information user behavior is limited. To explore multiple user preferences, we propose a transformer-based sequential recommendation model, named MrTransformer ( M ulti-p r eference Transformer ). For training MrTransformer, we devise a preference-editing -based self-supervised learning (SSL) mechanism that explores extra supervision signals based on relations with other sequences. The idea is to force the sequential recommendation model to discriminate between common and unique preferences in different sequences of interactions. By doing so, the sequential recommendation model is able to disentangle user preferences into multiple independent preference representations so as to improve user preference extraction and representation. We carry out extensive experiments on five benchmark datasets. MrTransformer with preference editing significantly outperforms state-of-the-art sequential recommendation methods in terms of Recall, MRR, and NDCG. We find that long sequences of interactions from which user preferences are harder to extract and represent benefit most from preference editing.

Funding

  • National Key R&D Program of China
  • Natural Science Foundation of China
  • Key Scientific and Technological Innovation Program of Shandong Province
  • Natural Science Foundation of Shandong Province
  • Tencent WeChat Rhino-Bird Focused Research Program
  • Fundamental Research Funds of Shandong University
  • Hybrid Intelligence Center
  • Dutch Ministry of Education, Culture and Science through the Netherlands Organisation for Scientific Research

Cite

APA

Ma, M., Ren, P., Chen, Z., Ren, Z., Liang, H., Ma, J., & Rijke, M. D. (2023). Improving Transformer-based Sequential Recommenders through Preference Editing. ACM Transactions on Information Systems, 41(3), 1-24. https://doi.org/10.1145/3564282

Vancouver

Ma M, Ren P, Chen Z, Ren Z, Liang H, Ma J, et al. Improving Transformer-based Sequential Recommenders through Preference Editing. ACM Transactions on Information Systems. 2023;41(3):1-24. doi:10.1145/3564282

BibTeX
@article{Ma2023,
  author = {Ma, Muyang and Ren, Pengjie and Chen, Zhumin and Ren, Zhaochun and Liang, Huasheng and Ma, Jun and Rijke, Maarten De},
  title = {Improving Transformer-based Sequential Recommenders through Preference Editing},
  journal = {ACM Transactions on Information Systems},
  year = {2023},
  volume = {41},
  number = {3},
  pages = {1--24},
  doi = {10.1145/3564282}
}
Start for free →