EUVIMEDEUVIMED entdecken
Crossref

Distributed Multiarmed Bandits

Jingxuan Zhu, Ji Liu

IEEE Transactions on Automatic Control · 2023-05 · 68 (5) · 3025-3040

DOI: 10.1109/tac.2023.3247982 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Automatic Control, 2023-05. Verfasst von Jingxuan Zhu und 1 weiteren Autor:innen. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 39 Literaturangaben. Gefördert von: National Science Foundation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This article studies a distributed multiarmed bandit problem with heterogeneous observations of rewards. The problem is cooperatively solved by $N$ agents assuming each agent faces a common set of $M$ arms yet observes only local biased rewards of the arms. The goal of each agent is to minimize the cumulative expected regret with respect to the true rewards of the arms, where the mean of each arm's true reward equals the average of the means of all agents' observed biased rewards. Each agent recursively updates its decision by utilizing the information from its neighbors. Neighbor relationships are described by a time-dependent directed graph $\mathbb{G}(t)$ whose vertices correspond to agents and whose arcs depict neighbor relationships. A fully distributed bandit algorithm is proposed, which couples the classical distributed averaging algorithm and the celebrated upper confidence bound bandit algorithm. It is shown that for any uniformly strongly connected sequence of $\mathbb{G}(t)$ , the algorithm achieves guaranteed regret for each agent at the order of $O(\log T)$ .

Förderung

  • National Science Foundation

Zitieren

APA

Zhu, J., & Liu, J. (2023). Distributed Multiarmed Bandits. IEEE Transactions on Automatic Control, 68(5), 3025-3040. https://doi.org/10.1109/tac.2023.3247982

Vancouver

Zhu J, Liu J. Distributed Multiarmed Bandits. IEEE Transactions on Automatic Control. 2023;68(5):3025-3040. doi:10.1109/tac.2023.3247982

BibTeX
@article{Zhu2023,
  author = {Zhu, Jingxuan and Liu, Ji},
  title = {Distributed Multiarmed Bandits},
  journal = {IEEE Transactions on Automatic Control},
  year = {2023},
  volume = {68},
  number = {5},
  pages = {3025--3040},
  doi = {10.1109/tac.2023.3247982}
}
Kostenlos starten →