Hypernetworks for Zero-Shot Transfer in Reinforcement Learning
Proceedings of the AAAI Conference on Artificial Intelligence · 26.06.2023 · 37 (8) · 9579-9587
DOI: 10.1609/aaai.v37i8.26146 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 26.06.2023. Verfasst von Sahand Rezaei-Shoshtari und 4 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref).
Abstract (Originalsprache)
In this paper, hypernetworks are trained to generate behaviors across a range of unseen task conditions, via a novel TD-based training objective and data from a set of near-optimal RL solutions for training tasks. This work relates to meta RL, contextual RL, and transfer learning, with a particular focus on zero-shot performance at test time, enabled by knowledge of the task parameters (also known as context). Our technical approach is based upon viewing each RL algorithm as a mapping from the MDP specifics to the near-optimal value function and policy and seek to approximate it with a hypernetwork that can generate near-optimal value functions and policies, given the parameters of the MDP. We show that, under certain conditions, this mapping can be considered as a supervised learning problem. We empirically evaluate the effectiveness of our method for zero-shot transfer to new reward and transition dynamics on a series of continuous control tasks from DeepMind Control Suite. Our method demonstrates significant improvements over baselines from multitask and meta RL approaches.
Zitieren
APA
Rezaei-Shoshtari, S., Morissette, C., Hogan, F. R., Dudek, G., & Meger, D. (2023). Hypernetworks for Zero-Shot Transfer in Reinforcement Learning. Proceedings of the AAAI Conference on Artificial Intelligence, 37(8), 9579-9587. https://doi.org/10.1609/aaai.v37i8.26146
Vancouver
Rezaei-Shoshtari S, Morissette C, Hogan FR, Dudek G, Meger D. Hypernetworks for Zero-Shot Transfer in Reinforcement Learning. Proceedings of the AAAI Conference on Artificial Intelligence. 2023;37(8):9579-9587. doi:10.1609/aaai.v37i8.26146
BibTeX
@article{RezaeiShoshtari2023,
author = {Rezaei-Shoshtari, Sahand and Morissette, Charlotte and Hogan, Francois R. and Dudek, Gregory and Meger, David},
title = {Hypernetworks for Zero-Shot Transfer in Reinforcement Learning},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
year = {2023},
volume = {37},
number = {8},
pages = {9579--9587},
doi = {10.1609/aaai.v37i8.26146}
}
EUVIMED