EUVIMEDEUVIMED entdecken
Crossref

Analyzing the BBOB Results by Means of Benchmarking Concepts

O Mersmann, M Preuss, H Trautmann, B Bischl, C Weihs

Evolutionary Computation · 2015-03 · 23 (1) · 161-185

DOI: 10.1162/evco_a_00134 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Evolutionary Computation, 2015-03. Verfasst von O Mersmann und 4 weiteren Autor:innen. Beteiligte Einrichtung: Chair of Computational Statistics, TU Dortmund University, Germany olafm@statistik.tu-dortmund.de. Hauptthemen laut MEDLINE: Algorithms, Models, Theoretical. Die Arbeit wurde bisher 43-mal zitiert (Crossref) und nennt 17 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

We present methods to answer two basic questions that arise when benchmarking optimization algorithms. The first one is: which algorithm is the “best” one? and the second one is: which algorithm should I use for my real-world problem? Both are connected and neither is easy to answer. We present a theoretical framework for designing and analyzing the raw data of such benchmark experiments. This represents a first step in answering the aforementioned questions. The 2009 and 2010 BBOB benchmark results are analyzed by means of this framework and we derive insight regarding the answers to the two questions. Furthermore, we discuss how to properly aggregate rankings from algorithm evaluations on individual problems into a consensus, its theoretical background and which common pitfalls should be avoided. Finally, we address the grouping of test problems into sets with similar optimizer rankings and investigate whether these are reflected by already proposed test problem characteristics, finding that this is not always the case.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

AlgorithmsModels, TheoreticalBenchmarkingComputer Simulation

Stichwörter der Autor:innen

BBOB test setEvolutionary optimizationbenchmarkingconsensus rankingexploratory landscape analysismultidimensional scaling

Autor:innen und Institutionen

  • Chair of Computational Statistics, TU Dortmund University, Germany olafm@statistik.tu-dortmund.de.

Zitieren

APA

Mersmann, O., Preuss, M., Trautmann, H., Bischl, B., & Weihs, C. (2015). Analyzing the BBOB Results by Means of Benchmarking Concepts. Evolutionary Computation, 23(1), 161-185. https://doi.org/10.1162/evco_a_00134

Vancouver

Mersmann O, Preuss M, Trautmann H, Bischl B, Weihs C. Analyzing the BBOB Results by Means of Benchmarking Concepts. Evolutionary Computation. 2015;23(1):161-185. doi:10.1162/evco_a_00134

BibTeX
@article{Mersmann2015,
  author = {Mersmann, O and Preuss, M and Trautmann, H and Bischl, B and Weihs, C},
  title = {Analyzing the BBOB Results by Means of Benchmarking Concepts},
  journal = {Evolutionary Computation},
  year = {2015},
  volume = {23},
  number = {1},
  pages = {161--185},
  doi = {10.1162/evco_a_00134}
}
Kostenlos starten →