EUVIMEDEUVIMED entdecken
Crossref

A Practitioner-Oriented Review of Reinforcement Learning for the Joint Optimization of Ads and Organic Content in Large-Scale Recommender Systems

Armando Ordorica, Yuri Lawryshyn

ACM Transactions on Recommender Systems · 17.11.2026

DOI: 10.1145/3859366 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Recommender Systems, online erschienen am 17.11.2026. Verfasst von Armando Ordorica und 1 weiteren Autor:innen. Die Arbeit nennt 113 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Balancing advertisements with organic content is a challenge for large-scale recommendation platforms. Ads are central to platform revenue, but jointly serving them with organic content creates trade-offs between monetization and user experience. Many production systems frame these decisions as supervised learning problems that optimize immediate ad clickthrough, estimating immediate outcomes under a historical logging policy while treating decisions as independent. Formulating joint ad and organic ranking as long-horizon optimization over action sequences, under policy-induced state evolution, remains an open research problem. Reinforcement Learning (RL) offers a principled framework for modeling recommendation as sequential decision-making under uncertainty, but at scale it must represent high-dimensional state and action spaces, specify robust reward functions, explore safely, and manage substantial computational cost. This practitioner-oriented survey synthesizes prior RL work on the joint optimization of ads and organic content, distilling design choices, trade-offs, and evaluation practices through a unifying taxonomy that organizes each system by how it formulates the Markov Decision Process (MDP) in terms of state, action, and reward, and learns its policy. We find that industrial systems favor hybrid architectures and offline or constrained RL, such as contextual bandits and counterfactual policy evaluation, that learn from logged data while balancing scalability, safety, and interpretability.

Zitieren

APA

Ordorica, A., & Lawryshyn, Y. (2026). A Practitioner-Oriented Review of Reinforcement Learning for the Joint Optimization of Ads and Organic Content in Large-Scale Recommender Systems. ACM Transactions on Recommender Systems. https://doi.org/10.1145/3859366

Vancouver

Ordorica A, Lawryshyn Y. A Practitioner-Oriented Review of Reinforcement Learning for the Joint Optimization of Ads and Organic Content in Large-Scale Recommender Systems. ACM Transactions on Recommender Systems. 2026. doi:10.1145/3859366

BibTeX
@article{Ordorica2026,
  author = {Ordorica, Armando and Lawryshyn, Yuri},
  title = {A Practitioner-Oriented Review of Reinforcement Learning for the Joint Optimization of Ads and Organic Content in Large-Scale Recommender Systems},
  journal = {ACM Transactions on Recommender Systems},
  year = {2026},
  doi = {10.1145/3859366}
}
Kostenlos starten →