EUVIMEDEUVIMED entdecken
Crossref

Exploration and Incentives in Reinforcement Learning

Max Simchowitz, Aleksandrs Slivkins

Operations Research · 2024-05 · 72 (3) · 983-998

DOI: 10.1287/opre.2022.0495 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Operations Research, 2024-05. Verfasst von Max Simchowitz und 1 weiteren Autor:innen. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 33 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

How do you incentivize self-interested agents to explore when they prefer to exploit? We consider complex exploration problems, where each agent faces the same (but unknown) Markov decision process (MDP). In contrast with traditional formulations of reinforcement learning (RL), agents control the choice of policies, whereas an algorithm can only issue recommendations. However, the algorithm controls the flow of information, and can incentivize the agents to explore via information asymmetry. We design an algorithm which explores all reachable states in the MDP. We achieve provable guarantees similar to those for incentivizing exploration in static, stateless exploration problems studied previously. From the RL perspective, we design RL mechanisms, that is, RL algorithms that interact with self-interested agents and are compatible with their incentives. This is the first paper on RL mechanisms, that is, the first paper on any scenario that combines RL and incentives, to the best of our knowledge.

Zitieren

APA

Simchowitz, M., & Slivkins, A. (2024). Exploration and Incentives in Reinforcement Learning. Operations Research, 72(3), 983-998. https://doi.org/10.1287/opre.2022.0495

Vancouver

Simchowitz M, Slivkins A. Exploration and Incentives in Reinforcement Learning. Operations Research. 2024;72(3):983-998. doi:10.1287/opre.2022.0495

BibTeX
@article{Simchowitz2024,
  author = {Simchowitz, Max and Slivkins, Aleksandrs},
  title = {Exploration and Incentives in Reinforcement Learning},
  journal = {Operations Research},
  year = {2024},
  volume = {72},
  number = {3},
  pages = {983--998},
  doi = {10.1287/opre.2022.0495}
}
Kostenlos starten →