Generalized Early Stopping in Evolutionary Direct Policy Search
ACM Transactions on Evolutionary Learning and Optimization · 30.09.2024 · 4 (3) · 1-28
DOI: 10.1145/3653024 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Evolutionary Learning and Optimization, online erschienen am 29.07.2024. Verfasst von Etor Arza und 2 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 51 Literaturangaben. Gefördert von: ELKARTEK program under project KONFLOT, Spanish Ministry of Economy and Competitiveness through BCAM Severo Ochoa excellence accreditation, Edinburgh Napier University through EPSRC.
Abstract (Originalsprache)
Lengthy evaluation times are common in many optimization problems such as direct policy search tasks, especially when they involve conducting evaluations in the physical world, for example, in robotics applications. Often when evaluating solution over a fixed time period, it becomes clear that the objective value will not increase with additional computation time (e.g., when a two-wheeled robot continuously spins on the spot). In such cases, it makes sense to stop the evaluation early to save computation time. However, most approaches to stop the evaluation are problem specific and need to be specifically designed for the task at hand. Therefore, we propose an early stopping method for direct policy search. The proposed method only looks at the objective value at each timestep and requires no problem-specific knowledge. We test the introduced stopping criterion in five direct policy search environments drawn from games, robotics, and classic control domains and show that it can save up to \(75\%\) of the computation time. We also compare it with problem-specific stopping criteria and show that it performs comparably, while being more generally applicable.
Förderung
- ELKARTEK program under project KONFLOT
- Spanish Ministry of Economy and Competitiveness through BCAM Severo Ochoa excellence accreditation
- Edinburgh Napier University through EPSRC
Zitieren
APA
Arza, E., Goff, L. K. L., & Hart, E. (2024). Generalized Early Stopping in Evolutionary Direct Policy Search. ACM Transactions on Evolutionary Learning and Optimization, 4(3), 1-28. https://doi.org/10.1145/3653024
Vancouver
Arza E, Goff LKL, Hart E. Generalized Early Stopping in Evolutionary Direct Policy Search. ACM Transactions on Evolutionary Learning and Optimization. 2024;4(3):1-28. doi:10.1145/3653024
BibTeX
@article{Arza2024,
author = {Arza, Etor and Goff, Léni K. Le and Hart, Emma},
title = {Generalized Early Stopping in Evolutionary Direct Policy Search},
journal = {ACM Transactions on Evolutionary Learning and Optimization},
year = {2024},
volume = {4},
number = {3},
pages = {1--28},
doi = {10.1145/3653024}
}
EUVIMED