Practically Unbiased Pairwise Loss for Recommendation With Implicit Feedback
IEEE Transactions on Pattern Analysis and Machine Intelligence · 2025-04 · 47 (4) · 2460-2474
DOI: 10.1109/tpami.2024.3519711 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2025-04. Verfasst von Tianwei Cao und 4 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 72 Literaturangaben. Gefördert von: National Key R&D Program of China, National Natural Science Foundation of China, Youth Innovative Research Team of BUPT.
Abstract (Originalsprache)
Recommender systems have been widely employed on various online platforms to improve user experience. In these systems, recommendation models are often learned from the users' historical behaviors that are automatically collected. Notably, recommender systems differ slightly from ordinary supervised learning tasks. In recommender systems, there is an exposure mechanism that decides which items could be presented to each specific user, which breaks the i.i.d assumption of supervised learning and brings biases into the recommendation models. In this paper, we focus on unbiased ranking loss weighted by inversed propensity scores (IPS), which are widely used in recommendations with implicit feedback labels. More specifically, we first highlight the fact that there is a gap between theory and practice in IPS-weighted unbiased loss. The existing pairwise loss could be theoretically unbiased by adopting an IPS weighting scheme. Unfortunately, the propensity scores are hard to estimate due to the inaccessibility of each user-item pair's true exposure status. In practical scenarios, we can only approximate the propensity scores. In this way, the theoretically unbiased loss would be still practically biased. To solve this problem, we first construct a theoretical framework to obtain a generalization upper bound of the current theoretically unbiased loss. The bound illustrates that we can ensure the theoretically unbiased loss's generalization ability if we lower its implementation loss and practical bias at the same time. To that aim, we suggest treating feedback label as a noisy proxy for exposure result for each user-item pair . Here we assume the noise rate meets the condition that . According to our analysis, this is a mild assumption that can be satisfied by many real-world applications. Based on this, we could train an accurate propensity model directly by leveraging a noise-resistant loss function. Then we could construct a practically unbiased recommendation model weighted by precise propensity scores. Lastly, experimental findings on public datasets demonstrate our suggested method's effectiveness.
Förderung
- National Key R&D Program of China
- National Natural Science Foundation of China
- Youth Innovative Research Team of BUPT
- Youth Innovation Promotion Association of the Chinese Academy of Sciences
- Strategic Priority Research Program of the Chinese Academy of Sciences
- Innovation Funding of ICT,CAS
- Beijing Natural Science Foundation
- Natural Science Foundation of Hebei Province
Zitieren
APA
Cao, T., Xu, Q., Yang, Z., Ma, Z., & Huang, Q. (2025). Practically Unbiased Pairwise Loss for Recommendation With Implicit Feedback. IEEE Transactions on Pattern Analysis and Machine Intelligence, 47(4), 2460-2474. https://doi.org/10.1109/tpami.2024.3519711
Vancouver
Cao T, Xu Q, Yang Z, Ma Z, Huang Q. Practically Unbiased Pairwise Loss for Recommendation With Implicit Feedback. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2025;47(4):2460-2474. doi:10.1109/tpami.2024.3519711
BibTeX
@article{Cao2025,
author = {Cao, Tianwei and Xu, Qianqian and Yang, Zhiyong and Ma, Zhanyu and Huang, Qingming},
title = {Practically Unbiased Pairwise Loss for Recommendation With Implicit Feedback},
journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
year = {2025},
volume = {47},
number = {4},
pages = {2460--2474},
doi = {10.1109/tpami.2024.3519711}
}
EUVIMED