Revisiting Negative Sampling vs. Non-sampling in Implicit Recommendation
ACM Transactions on Information Systems · 31.01.2023 · 41 (1) · 1-25
DOI: 10.1145/3522672 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Information Systems, online erschienen am 25.02.2023. Verfasst von Chong Chen und 5 weiteren Autor:innen. Die Arbeit wurde bisher 103-mal zitiert (Crossref) und nennt 82 Literaturangaben. Gefördert von: Natural Science Foundation of China, Tsinghua University Guoqiang Research Institute.
Abstract (Originalsprache)
Recommendation systems play an important role in alleviating the information overload issue. Generally, a recommendation model is trained to discern between positive (liked) and negative (disliked) instances for each user. However, under the open-world assumption, there are only positive instances but no negative instances from users’ implicit feedback, which poses the imbalanced learning challenge of lacking negative samples. To address this, two types of learning strategies have been proposed before, the negative sampling strategy and non-sampling strategy. The first strategy samples negative instances from missing data (i.e., unlabeled data), while the non-sampling strategy regards all the missing data as negative. Although learning strategies are known to be essential for algorithm performance, the in-depth comparison of negative sampling and non-sampling has not been sufficiently explored by far. To bridge this gap, we systematically analyze the role of negative sampling and non-sampling for implicit recommendation in this work. Specifically, we first theoretically revisit the objection of negative sampling and non-sampling. Then, with a careful setup of various representative recommendation methods, we explore the performance of negative sampling and non-sampling in different scenarios. Our results empirically show that although negative sampling has been widely applied to recent recommendation models, it is non-trivial for uniform sampling methods to show comparable performance to non-sampling learning methods. Finally, we discuss the scalability and complexity of negative sampling and non-sampling and present some open problems and future research topics that are worth being further explored.
Förderung
- Natural Science Foundation of China
- Tsinghua University Guoqiang Research Institute
Zitieren
APA
Chen, C., Ma, W., Zhang, M., Wang, C., Liu, Y., & Ma, S. (2023). Revisiting Negative Sampling vs. Non-sampling in Implicit Recommendation. ACM Transactions on Information Systems, 41(1), 1-25. https://doi.org/10.1145/3522672
Vancouver
Chen C, Ma W, Zhang M, Wang C, Liu Y, Ma S. Revisiting Negative Sampling vs. Non-sampling in Implicit Recommendation. ACM Transactions on Information Systems. 2023;41(1):1-25. doi:10.1145/3522672
BibTeX
@article{Chen2023,
author = {Chen, Chong and Ma, Weizhi and Zhang, Min and Wang, Chenyang and Liu, Yiqun and Ma, Shaoping},
title = {Revisiting Negative Sampling vs. Non-sampling in Implicit Recommendation},
journal = {ACM Transactions on Information Systems},
year = {2023},
volume = {41},
number = {1},
pages = {1--25},
doi = {10.1145/3522672}
}
EUVIMED