EUVIMEDOpdag EUVIMED
Systematische ÜbersichtOpen access · CC BY 4.0

Evolutionary Reinforcement Learning: A Systematic Review and Future Directions

Yuanguo Lin, Fan Lin, Guorong Cai, Hong Chen, Linxin Zou, Yunxuan Liu, Pengcheng Wu

Mathematics · 2025-03-02 · 13 (5) · 833

DOI: 10.3390/math13050833 ↗

At a glance

Systematische Übersicht in Mathematics, published online on 2025-03-02. Written by Yuanguo Lin and 6 co-authors. Cited 27 times so far (Crossref); 126 references. The full text is freely available (open access, CC BY 4.0). Funded by: National Natural Science Foundation of China, Xiamen Science and Technology Subsidy Project, Startup Fund of Jimei University.

AbstractBibliografiske oplysningerCiteRelated studies

Abstract (original language)

In response to the limitations of reinforcement learning and Evolutionary Algorithms (EAs) in complex problem-solving, Evolutionary Reinforcement Learning (EvoRL) has emerged as a synergistic solution. This systematic review aims to provide a comprehensive analysis of EvoRL, examining the symbiotic relationship between EAs and reinforcement learning algorithms and identifying critical gaps in relevant application tasks. The review begins by outlining the technological foundations of EvoRL, detailing the complementary relationship between EAs and reinforcement learning algorithms to address the limitations of reinforcement learning, such as parameter sensitivity, sparse rewards, and its susceptibility to local optima. We then delve into the challenges faced by both reinforcement learning and EvoRL, exploring the utility and limitations of EAs in EvoRL. EvoRL itself is constrained by the sampling efficiency and algorithmic complexity, which affect its application in areas like robotic control and large-scale industrial settings. Furthermore, we address significant open issues in the field, such as adversarial robustness, fairness, and ethical considerations. Finally, we propose future directions for EvoRL, emphasizing research avenues that strive to enhance self-adaptation, self-improvement, scalability, interpretability, and so on. To quantify the current state, we analyzed about 100 EvoRL studies, categorizing them based on algorithms, performance metrics, and benchmark tasks. Serving as a comprehensive resource for researchers and practitioners, this systematic review provides insights into the current state of EvoRL and offers a guide for advancing its capabilities in the ever-evolving landscape of artificial intelligence.

Funding

  • National Natural Science Foundation of China
  • Xiamen Science and Technology Subsidy Project
  • Startup Fund of Jimei University

Cite

APA

Lin, Y., Lin, F., Cai, G., Chen, H., Zou, L., Liu, Y., & Wu, P. (2025). Evolutionary Reinforcement Learning: A Systematic Review and Future Directions. Mathematics, 13(5), 833. https://doi.org/10.3390/math13050833

Vancouver

Lin Y, Lin F, Cai G, Chen H, Zou L, Liu Y, et al. Evolutionary Reinforcement Learning: A Systematic Review and Future Directions. Mathematics. 2025;13(5):833. doi:10.3390/math13050833

BibTeX
@article{Lin2025,
  author = {Lin, Yuanguo and Lin, Fan and Cai, Guorong and Chen, Hong and Zou, Linxin and Liu, Yunxuan and Wu, Pengcheng},
  title = {Evolutionary Reinforcement Learning: A Systematic Review and Future Directions},
  journal = {Mathematics},
  year = {2025},
  volume = {13},
  number = {5},
  pages = {833},
  doi = {10.3390/math13050833}
}
Start for free →