EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-SA 4.0

Intrinsically Motivated Multi-Goal Reinforcement Learning Using Robotics Environment Integrated with OpenAI Gym

Sivasubramanian Balasubramanian

Journal of Science & Technology · 17.11.2023 · 4 (5) · 46-60

DOI: 10.55662/jst.2023.4502 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Science & Technology, online erschienen am 17.11.2023. Verfasst von Sivasubramanian Balasubramanian. Die Arbeit wurde bisher 4-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY-NC-SA 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Sparse reward is one of the most challenging problems in reinforcement learning (RL). Hindsight Experience Replay (HER) attempts to address this issue by converting a failed experience to a successful one by relabelling the goals. In open-ended and changing environments, agents face a wide range of potential tasks that might not come with associated reward functions. Such autonomous learning agents must set their own tasks and build their own curriculum through an intrinsically motivated exploration. Because some tasks might prove easy and some impossible, agents must actively select which task to practice at any given moment, to maximize their overall mastery on the set of learnable tasks. The purpose of this technical report is two-fold. First, it introduces a suite of challenging continuous control tasks (integrated with OpenAI Gym) based on currently existing robotics hardware. The tasks include pushing, sliding and pick & place with a Fetch robotic arm as well as in-hand object manipulation with a Shadow Dexterous Hand. All tasks have sparse binary rewards and follow a Multi-Goal Reinforcement Learning (RL) framework in which an agent is told what to do using an additional input. The second part of the paper presents a set of concrete research ideas for improving RL algorithms, most of which are related to Multi-Goal RL and Hindsight Experience Replay. The Fetch environments are based on the 7-DoF Fetch robotics arm,2 which has a two-fingered parallel gripper. Agents focus on achievable tasks first and focus back on tasks that are being forgotten. Experiments conducted in a new multi-task multi-goal robotic environment show that our algorithm benefits from these two ideas and demonstrate properties of robustness to distracting tasks, forgetting and changes in body properties

Zitieren

APA

Balasubramanian, S. (2023). Intrinsically Motivated Multi-Goal Reinforcement Learning Using Robotics Environment Integrated with OpenAI Gym. Journal of Science & Technology, 4(5), 46-60. https://doi.org/10.55662/jst.2023.4502

Vancouver

Balasubramanian S. Intrinsically Motivated Multi-Goal Reinforcement Learning Using Robotics Environment Integrated with OpenAI Gym. Journal of Science & Technology. 2023;4(5):46-60. doi:10.55662/jst.2023.4502

BibTeX
@article{Balasubramanian2023,
  author = {Balasubramanian, Sivasubramanian},
  title = {Intrinsically Motivated Multi-Goal Reinforcement Learning Using Robotics Environment Integrated with OpenAI Gym},
  journal = {Journal of Science & Technology},
  year = {2023},
  volume = {4},
  number = {5},
  pages = {46--60},
  doi = {10.55662/jst.2023.4502}
}
Kostenlos starten →