Efficient Contextual Bandit Learning via Reward-Space Sampling and Online Optimization (Student Abstract)
Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (48) · 41398-41399
DOI: 10.1609/aaai.v40i48.42284 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Egor Suraveikin und 3 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref).
Abstract (Originalsprache)
The contextual multi-armed bandit problem underlies applications in recommendations, e-commerce, finance, and healthcare, where balancing exploration and exploitation is critical. While algorithms such as Upper Confidence Bound (UCB) and Thompson Sampling (TS) achieve strong theoretical guarantees, they often incur heavy computational cost from high-dimensional parameter estimation. We propose a new approach that combines reward sampling with online stochastic optimization. At each round, the algorithm samples hypothetical rewards for all actions and selects the action with the largest draw; the observed reward then updates the model via stochastic optimization. This design is both simple and efficient, preserving exploration while avoiding the pitfalls of greedy behavior on near-duplicate arms. Across synthetic and real-world datasets, our method attains near-optimal reward more quickly and with substantially lower computation than TS and UCB, demonstrating that sampling directly in reward space can improve both statistical efficiency and scalability.
Zitieren
APA
Suraveikin, E., Omirzak, D., Sultimov, R., & Maximov, Y. (2026). Efficient Contextual Bandit Learning via Reward-Space Sampling and Online Optimization (Student Abstract). Proceedings of the AAAI Conference on Artificial Intelligence, 40(48), 41398-41399. https://doi.org/10.1609/aaai.v40i48.42284
Vancouver
Suraveikin E, Omirzak D, Sultimov R, Maximov Y. Efficient Contextual Bandit Learning via Reward-Space Sampling and Online Optimization (Student Abstract). Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(48):41398-41399. doi:10.1609/aaai.v40i48.42284
BibTeX
@article{Suraveikin2026,
author = {Suraveikin, Egor and Omirzak, Dastan and Sultimov, Roman and Maximov, Yury},
title = {Efficient Contextual Bandit Learning via Reward-Space Sampling and Online Optimization (Student Abstract)},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
year = {2026},
volume = {40},
number = {48},
pages = {41398--41399},
doi = {10.1609/aaai.v40i48.42284}
}
EUVIMED