EUVIMEDOpdag EUVIMED
Crossref

Greed Is Good: Exploration and Exploitation Trade-offs in Bayesian Optimisation

George De Ath, Richard M. Everson, Alma A. M. Rahat, Jonathan E. Fieldsend

ACM Transactions on Evolutionary Learning and Optimization · 2021

DOI: 10.1145/3425501 ↗

At a glance

Journal article in ACM Transactions on Evolutionary Learning and Optimization, 2021. Written by George De Ath and 3 co-authors. Cited 107 times so far (Crossref); 38 references. Funded by: Innovate UK.

AbstractBibliografiske oplysningerCiteRelated studies

Abstract (original language)

The performance of acquisition functions for Bayesian optimisation to locate the global optimum of continuous functions is investigated in terms of the Pareto front between exploration and exploitation. We show that Expected Improvement (EI) and the Upper Confidence Bound (UCB) always select solutions to be expensively evaluated on the Pareto front, but Probability of Improvement is not guaranteed to do so and Weighted Expected Improvement does so only for a restricted range of weights. We introduce two novel -greedy acquisition functions. Extensive empirical evaluation of these together with random search, purely exploratory, and purely exploitative search on 10 benchmark problems in 1 to 10 dimensions shows that -greedy algorithms are generally at least as effective as conventional acquisition functions (e.g., EI and UCB), particularly with a limited budget. In higher dimensions, -greedy approaches are shown to have improved performance over conventional approaches. These results are borne out on a real-world computational fluid dynamics optimisation problem and a robotics active learning problem. Our analysis and experiments suggest that the most effective strategy, particularly in higher dimensions, is to be mostly greedy, occasionally selecting a random exploratory solution.

Funding

  • Innovate UK

Cite

APA

Ath, G. D., Everson, R. M., Rahat, A. A. M., & Fieldsend, J. E. (2021). Greed Is Good: Exploration and Exploitation Trade-offs in Bayesian Optimisation. ACM Transactions on Evolutionary Learning and Optimization. https://doi.org/10.1145/3425501

Vancouver

Ath GD, Everson RM, Rahat AAM, Fieldsend JE. Greed Is Good: Exploration and Exploitation Trade-offs in Bayesian Optimisation. ACM Transactions on Evolutionary Learning and Optimization. 2021. doi:10.1145/3425501

BibTeX
@article{Ath2021,
  author = {Ath, George De and Everson, Richard M. and Rahat, Alma A. M. and Fieldsend, Jonathan E.},
  title = {Greed Is Good: Exploration and Exploitation Trade-offs in Bayesian Optimisation},
  journal = {ACM Transactions on Evolutionary Learning and Optimization},
  year = {2021},
  doi = {10.1145/3425501}
}
Start for free →