EUVIMEDEUVIMED entdecken
Crossref

Reusability and Transferability of Macro Actions for Reinforcement Learning

Yi-Hsiang Chang, Kuan-Yu Chang, Henry Kuo, Chun-Yi Lee

ACM Transactions on Evolutionary Learning and Optimization · 2022

DOI: 10.1145/3514260 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Evolutionary Learning and Optimization, 2022. Verfasst von Yi-Hsiang Chang und 3 weiteren Autor:innen. Die Arbeit nennt 35 Literaturangaben. Gefördert von: Ministry of Science and Technology.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Conventional reinforcement learning (RL) typically determines an appropriate primitive action at each timestep. However, by using a proper macro action, defined as a sequence of primitive actions, an RL agent is able to bypass intermediate states to a farther state and facilitate its learning procedure. The problem we would like to investigate is what associated beneficial properties that macro actions may possess. In this article, we unveil the properties of reusability and transferability of macro actions. The first property, reusability , means that a macro action derived along with one RL method can be reused by another RL method for training, while the second one, transferability , indicates that a macro action can be utilized for training agents in similar environments with different reward settings. In our experiments, we first derive macro actions along with RL methods. We then provide a set of analyses to reveal the properties of reusability and transferability of the derived macro actions.

Förderung

  • Ministry of Science and Technology

Zitieren

APA

Chang, Y., Chang, K., Kuo, H., & Lee, C. (2022). Reusability and Transferability of Macro Actions for Reinforcement Learning. ACM Transactions on Evolutionary Learning and Optimization. https://doi.org/10.1145/3514260

Vancouver

Chang Y, Chang K, Kuo H, Lee C. Reusability and Transferability of Macro Actions for Reinforcement Learning. ACM Transactions on Evolutionary Learning and Optimization. 2022. doi:10.1145/3514260

BibTeX
@article{Chang2022,
  author = {Chang, Yi-Hsiang and Chang, Kuan-Yu and Kuo, Henry and Lee, Chun-Yi},
  title = {Reusability and Transferability of Macro Actions for Reinforcement Learning},
  journal = {ACM Transactions on Evolutionary Learning and Optimization},
  year = {2022},
  doi = {10.1145/3514260}
}
Kostenlos starten →