Co-Evolutionary Proximal Distilled Evolutionary Reinforcement Learning with Gated Knowledge Transfer
Mathematics · 23.03.2026 · 14 (6) · 1078
DOI: 10.3390/math14061078 ↗Kurz gefasst
Fachartikel in der Zeitschrift Mathematics, online erschienen am 23.03.2026. Verfasst von Ying Zhao und 2 weiteren Autor:innen. Die Arbeit nennt 38 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Key Research and Development Program of Hunan Province, China Postdoctoral Science Foundation.
Abstract (Originalsprache)
Evolutionary reinforcement learning (ERL) offers a compelling alternative for continuous control by combining the population-level exploration of evolutionary algorithms with the gradient-based exploitation of reinforcement learning. However, applying conventional genetic operators to deep networks can be highly destructive, often inducing abrupt behavioral shifts that erase previously learned skills. Proximal distilled evolutionary reinforcement learning (PDERL) addresses this issue with phenotype-aware operators, leveraging proximal mutation and distillation crossover to produce safer and more constructive variations. Despite these advances, PDERL and many ERL frameworks still exhibit a fundamental evaluation asymmetry: an evolving actor population is guided by a single, centralized critic for fitness evaluation and action filtering. This single-critic dependence creates a bottleneck and a potential single point of failure, where bias or instability in value estimation can misdirect the evolutionary search. To overcome this limitation, we propose co-evolutionary proximal distilled evolutionary reinforcement learning (Co-PDERL), a heterogeneous dual-population framework that co-evolves both actor and critic populations. Co-PDERL extends phenotype-aware evolution to the value-function landscape via a loss-filtered distillation crossover and a Jacobian-based proximal mutation tailored for critics, and employs a condition-gated synchronization mechanism to enable robust bidirectional knowledge transfer between the evolutionary populations and the reinforcement learning agent. Experiments on MuJoCo continuous control benchmarks show that Co-PDERL outperforms competitive baselines on most tasks, including standard ERL and PDERL, improving both sample efficiency and asymptotic performance by effectively alleviating the single-critic bottleneck.
Förderung
- National Natural Science Foundation of China
- Key Research and Development Program of Hunan Province
- China Postdoctoral Science Foundation
Zitieren
APA
Zhao, Y., Ding, Y., & Dai, Y. (2026). Co-Evolutionary Proximal Distilled Evolutionary Reinforcement Learning with Gated Knowledge Transfer. Mathematics, 14(6), 1078. https://doi.org/10.3390/math14061078
Vancouver
Zhao Y, Ding Y, Dai Y. Co-Evolutionary Proximal Distilled Evolutionary Reinforcement Learning with Gated Knowledge Transfer. Mathematics. 2026;14(6):1078. doi:10.3390/math14061078
BibTeX
@article{Zhao2026,
author = {Zhao, Ying and Ding, Yi and Dai, Yinglong},
title = {Co-Evolutionary Proximal Distilled Evolutionary Reinforcement Learning with Gated Knowledge Transfer},
journal = {Mathematics},
year = {2026},
volume = {14},
number = {6},
pages = {1078},
doi = {10.3390/math14061078}
}
EUVIMED