EUVIMEDEUVIMED entdecken
Crossref

Hypernetworks for Zero-Shot Transfer in Reinforcement Learning

Sahand Rezaei-Shoshtari, Charlotte Morissette, Francois R. Hogan, Gregory Dudek, David Meger

Proceedings of the AAAI Conference on Artificial Intelligence · 26.06.2023 · 37 (8) · 9579-9587

DOI: 10.1609/aaai.v37i8.26146 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 26.06.2023. Verfasst von Sahand Rezaei-Shoshtari und 4 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In this paper, hypernetworks are trained to generate behaviors across a range of unseen task conditions, via a novel TD-based training objective and data from a set of near-optimal RL solutions for training tasks. This work relates to meta RL, contextual RL, and transfer learning, with a particular focus on zero-shot performance at test time, enabled by knowledge of the task parameters (also known as context). Our technical approach is based upon viewing each RL algorithm as a mapping from the MDP specifics to the near-optimal value function and policy and seek to approximate it with a hypernetwork that can generate near-optimal value functions and policies, given the parameters of the MDP. We show that, under certain conditions, this mapping can be considered as a supervised learning problem. We empirically evaluate the effectiveness of our method for zero-shot transfer to new reward and transition dynamics on a series of continuous control tasks from DeepMind Control Suite. Our method demonstrates significant improvements over baselines from multitask and meta RL approaches.

Zitieren

APA

Rezaei-Shoshtari, S., Morissette, C., Hogan, F. R., Dudek, G., & Meger, D. (2023). Hypernetworks for Zero-Shot Transfer in Reinforcement Learning. Proceedings of the AAAI Conference on Artificial Intelligence, 37(8), 9579-9587. https://doi.org/10.1609/aaai.v37i8.26146

Vancouver

Rezaei-Shoshtari S, Morissette C, Hogan FR, Dudek G, Meger D. Hypernetworks for Zero-Shot Transfer in Reinforcement Learning. Proceedings of the AAAI Conference on Artificial Intelligence. 2023;37(8):9579-9587. doi:10.1609/aaai.v37i8.26146

BibTeX
@article{RezaeiShoshtari2023,
  author = {Rezaei-Shoshtari, Sahand and Morissette, Charlotte and Hogan, Francois R. and Dudek, Gregory and Meger, David},
  title = {Hypernetworks for Zero-Shot Transfer in Reinforcement Learning},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2023},
  volume = {37},
  number = {8},
  pages = {9579--9587},
  doi = {10.1609/aaai.v37i8.26146}
}
Kostenlos starten →