EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Doubly Robust Estimation for Correcting Position Bias in Click Feedback for Unbiased Learning to Rank

Harrie Oosterhuis

ACM Transactions on Information Systems · 31.07.2023 · 41 (3) · 1-33

DOI: 10.1145/3569453 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Information Systems, online erschienen am 07.02.2023. Verfasst von Harrie Oosterhuis. Die Arbeit wurde bisher 31-mal zitiert (Crossref) und nennt 57 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Google Research Scholar Program.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Clicks on rankings suffer from position bias: generally items on lower ranks are less likely to be examined—and thus clicked—by users, in spite of their actual preferences between items. The prevalent approach to unbiased click-based learning-to-rank (LTR) is based on counterfactual inverse-propensity-scoring (IPS) estimation. In contrast with general reinforcement learning, counterfactual doubly robust (DR) estimation has not been applied to click-based LTR in previous literature. In this article, we introduce a novel DR estimator that is the first DR approach specifically designed for position bias. The difficulty with position bias is that the treatment—user examination—is not directly observable in click data. As a solution, our estimator uses the expected treatment per rank, instead of the actual treatment that existing DR estimators use. Our novel DR estimator has more robust unbiasedness conditions than the existing IPS approach, and in addition, provides enormous decreases in variance: our experimental results indicate it requires several orders of magnitude fewer datapoints to converge at optimal performance. For the unbiased LTR field, our DR estimator contributes both increases in state-of-the-art performance and the most robust theoretical guarantees of all known LTR estimators.

Förderung

  • Google Research Scholar Program

Zitieren

APA

Oosterhuis, H. (2023). Doubly Robust Estimation for Correcting Position Bias in Click Feedback for Unbiased Learning to Rank. ACM Transactions on Information Systems, 41(3), 1-33. https://doi.org/10.1145/3569453

Vancouver

Oosterhuis H. Doubly Robust Estimation for Correcting Position Bias in Click Feedback for Unbiased Learning to Rank. ACM Transactions on Information Systems. 2023;41(3):1-33. doi:10.1145/3569453

BibTeX
@article{Oosterhuis2023,
  author = {Oosterhuis, Harrie},
  title = {Doubly Robust Estimation for Correcting Position Bias in Click Feedback for Unbiased Learning to Rank},
  journal = {ACM Transactions on Information Systems},
  year = {2023},
  volume = {41},
  number = {3},
  pages = {1--33},
  doi = {10.1145/3569453}
}
Kostenlos starten →