Speeding Up Hyperparameter Optimization of Deep Neural Networks: A Review of Multi-Fidelity-Based Methods
ACM Computing Surveys · 30.09.2026 · 58 (12) · 1-36
DOI: 10.1145/3815108 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Computing Surveys, online erschienen am 09.06.2026. Verfasst von Antonio R. Moya und 1 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 106 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: Spanish Ministry of Science and Innovation and the European Regional Development Fund, Ministry of Universities.
Abstract (Originalsprache)
Deep Learning models are usually long to train and evaluate that performing an adequate hyperparameter optimization is intractable. Different algorithms based on fidelity evaluations, also known as multi-fidelity algorithms, have been proposed to speed up the hyperparameter optimization process so far. This article aims at reviewing the state-of-the-art algorithms in multi-fidelity and define an accurate taxonomy to classify them. It includes an accurate description of the strengths and weaknesses of these algorithms not only from a descriptive but also an experimental perspective. These experiments involved different problems and conditions to perform a fair evaluation of the proposal’s performance and computational cost.
Förderung
- Spanish Ministry of Science and Innovation and the European Regional Development Fund
- Ministry of Universities
Zitieren
APA
Moya, A. R., & Ventura, S. (2026). Speeding Up Hyperparameter Optimization of Deep Neural Networks: A Review of Multi-Fidelity-Based Methods. ACM Computing Surveys, 58(12), 1-36. https://doi.org/10.1145/3815108
Vancouver
Moya AR, Ventura S. Speeding Up Hyperparameter Optimization of Deep Neural Networks: A Review of Multi-Fidelity-Based Methods. ACM Computing Surveys. 2026;58(12):1-36. doi:10.1145/3815108
BibTeX
@article{Moya2026,
author = {Moya, Antonio R. and Ventura, Sebastian},
title = {Speeding Up Hyperparameter Optimization of Deep Neural Networks: A Review of Multi-Fidelity-Based Methods},
journal = {ACM Computing Surveys},
year = {2026},
volume = {58},
number = {12},
pages = {1--36},
doi = {10.1145/3815108}
}
EUVIMED