EUVIMEDObjevte EUVIMED
Crossref

Evolutionary Reinforcement Learning: A Survey

Hui Bai, Ran Cheng, Yaochu Jin

Intelligent Computing · 2023-01 · 2

DOI: 10.34133/icomputing.0025 ↗

At a glance

Journal article in Intelligent Computing, published online on 2023-05-10. Written by Hui Bai and 2 co-authors. Cited 97 times so far (Crossref); 257 references.

AbstraktBibliografické údajeCiteRelated studies

Abstract (original language)

Reinforcement learning (RL) is a machine learning approach that trains agents to maximize cumulative rewards through interactions with environments. The integration of RL with deep learning has recently resulted in impressive achievements in a wide range of challenging tasks, including board games, arcade games, and robot control. Despite these successes, several critical challenges remain, such as brittle convergence properties caused by sensitive hyperparameters, difficulties in temporal credit assignment with long time horizons and sparse rewards, a lack of diverse exploration, particularly in continuous search space scenarios, challenges in credit assignment in multi-agent RL, and conflicting objectives for rewards. Evolutionary computation (EC), which maintains a population of learning agents, has demonstrated promising performance in addressing these limitations. This article presents a comprehensive survey of state-of-the-art methods for integrating EC into RL, referred to as evolutionary reinforcement learning (EvoRL). We categorize EvoRL methods according to key research areas in RL, including hyperparameter optimization, policy search, exploration, reward shaping, meta-RL, and multi-objective RL. We then discuss future research directions in terms of efficient methods, benchmarks, and scalable platforms. This survey serves as a resource for researchers and practitioners interested in the field of EvoRL, highlighting the important challenges and opportunities for future research. With the help of this survey, researchers and practitioners can develop more efficient methods and tailored benchmarks for EvoRL, further advancing this promising cross-disciplinary research field.

Cite

APA

Bai, H., Cheng, R., & Jin, Y. (2023). Evolutionary Reinforcement Learning: A Survey. Intelligent Computing, 2. https://doi.org/10.34133/icomputing.0025

Vancouver

Bai H, Cheng R, Jin Y. Evolutionary Reinforcement Learning: A Survey. Intelligent Computing. 2023;2. doi:10.34133/icomputing.0025

BibTeX
@article{Bai2023,
  author = {Bai, Hui and Cheng, Ran and Jin, Yaochu},
  title = {Evolutionary Reinforcement Learning: A Survey},
  journal = {Intelligent Computing},
  year = {2023},
  volume = {2},
  doi = {10.34133/icomputing.0025}
}
Start for free →