EUVIMEDEUVIMED entdecken
Crossref

Efficient Contextual Bandit Learning via Reward-Space Sampling and Online Optimization (Student Abstract)

Egor Suraveikin, Dastan Omirzak, Roman Sultimov, Yury Maximov

Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (48) · 41398-41399

DOI: 10.1609/aaai.v40i48.42284 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Egor Suraveikin und 3 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The contextual multi-armed bandit problem underlies applications in recommendations, e-commerce, finance, and healthcare, where balancing exploration and exploitation is critical. While algorithms such as Upper Confidence Bound (UCB) and Thompson Sampling (TS) achieve strong theoretical guarantees, they often incur heavy computational cost from high-dimensional parameter estimation. We propose a new approach that combines reward sampling with online stochastic optimization. At each round, the algorithm samples hypothetical rewards for all actions and selects the action with the largest draw; the observed reward then updates the model via stochastic optimization. This design is both simple and efficient, preserving exploration while avoiding the pitfalls of greedy behavior on near-duplicate arms. Across synthetic and real-world datasets, our method attains near-optimal reward more quickly and with substantially lower computation than TS and UCB, demonstrating that sampling directly in reward space can improve both statistical efficiency and scalability.

Zitieren

APA

Suraveikin, E., Omirzak, D., Sultimov, R., & Maximov, Y. (2026). Efficient Contextual Bandit Learning via Reward-Space Sampling and Online Optimization (Student Abstract). Proceedings of the AAAI Conference on Artificial Intelligence, 40(48), 41398-41399. https://doi.org/10.1609/aaai.v40i48.42284

Vancouver

Suraveikin E, Omirzak D, Sultimov R, Maximov Y. Efficient Contextual Bandit Learning via Reward-Space Sampling and Online Optimization (Student Abstract). Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(48):41398-41399. doi:10.1609/aaai.v40i48.42284

BibTeX
@article{Suraveikin2026,
  author = {Suraveikin, Egor and Omirzak, Dastan and Sultimov, Roman and Maximov, Yury},
  title = {Efficient Contextual Bandit Learning via Reward-Space Sampling and Online Optimization (Student Abstract)},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2026},
  volume = {40},
  number = {48},
  pages = {41398--41399},
  doi = {10.1609/aaai.v40i48.42284}
}
Kostenlos starten →