Solving multi-armed bandit problems using a chaotic microresonator comb
APL Photonics · 01.03.2024 · 9 (3)
DOI: 10.1063/5.0173287 ↗Kurz gefasst
Fachartikel in der Zeitschrift APL Photonics, online erschienen am 19.03.2024. Verfasst von Jonathan Cuevas und 4 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 51 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Japan Society for the Promotion of Science, Cabinet Office, Government of Japan, JST, the establishment of university fellowships towards the creation of science technology innovation.
Abstract (Originalsprache)
The Multi-Armed Bandit (MAB) problem, foundational to reinforcement learning-based decision-making, addresses the challenge of maximizing rewards amid multiple uncertain choices. While algorithmic solutions are effective, their computational efficiency diminishes with increasing problem complexity. Photonic accelerators, leveraging temporal and spatial-temporal chaos, have emerged as promising alternatives. However, despite these advancements, current approaches either compromise computation speed or amplify system complexity. In this paper, we introduce a chaotic microresonator frequency comb (chaotic comb) to tackle the MAB problem, where each comb mode is assigned to a slot machine. Through a proof-of-concept experiment, we employ 44 comb modes to address an MAB with 44 slot machines, demonstrating performance competitive with both conventional software algorithms and other photonic methods. Furthermore, the scalability of decision making is explored with up to 512 slot machines using experimentally obtained temporal chaos in different time slots. Power-law scalability is achieved with an exponent of 0.96, outperforming conventional software-based algorithms. Moreover, we find that a numerically calculated chaotic comb accurately reproduces experimental results, paving the way for discussions on strategies to increase the number of slot machines.
Förderung
- Japan Society for the Promotion of Science
- Cabinet Office, Government of Japan
- JST, the establishment of university fellowships towards the creation of science technology innovation
Zitieren
APA
Cuevas, J., Iwami, R., Uchida, A., Minoshima, K., & Kuse, N. (2024). Solving multi-armed bandit problems using a chaotic microresonator comb. APL Photonics, 9(3). https://doi.org/10.1063/5.0173287
Vancouver
Cuevas J, Iwami R, Uchida A, Minoshima K, Kuse N. Solving multi-armed bandit problems using a chaotic microresonator comb. APL Photonics. 2024;9(3). doi:10.1063/5.0173287
BibTeX
@article{Cuevas2024,
author = {Cuevas, Jonathan and Iwami, Ryugo and Uchida, Atsushi and Minoshima, Kaoru and Kuse, Naoya},
title = {Solving multi-armed bandit problems using a chaotic microresonator comb},
journal = {APL Photonics},
year = {2024},
volume = {9},
number = {3},
doi = {10.1063/5.0173287}
}
EUVIMED