Hyperparameter Search for Machine Learning Algorithms for Optimizing the Computational Complexity
Processes · 21.01.2023 · 11 (2) · 349
DOI: 10.3390/pr11020349 ↗Kurz gefasst
Fachartikel in der Zeitschrift Processes, online erschienen am 21.01.2023. Verfasst von Yasser Ali und 3 weiteren Autor:innen. Die Arbeit wurde bisher 341-mal zitiert (Crossref) und nennt 27 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Research & Innovation, Ministry of Education in Saudi Arabia.
Abstract (Originalsprache)
For machine learning algorithms, fine-tuning hyperparameters is a computational challenge due to the large size of the problem space. An efficient strategy for adjusting hyperparameters can be established with the use of the greedy search and Swarm intelligence algorithms. The Random Search and Grid Search optimization techniques show promise and efficiency for this task. The small population of solutions used at the outset, and the costly goal functions used by these searches, can lead to slow convergence or execution time in some cases. In this research, we propose using the machine learning model known as Support Vector Machine and optimizing it using four distinct algorithms—the Ant Bee Colony Algorithm, the Genetic Algorithm, the Whale Optimization, and the Particle Swarm Optimization—to evaluate the computational cost of SVM after hyper-tuning. Computational complexity comparisons of these optimization algorithms were performed to determine the most effective strategies for hyperparameter tuning. It was found that the Genetic Algorithm had a lower temporal complexity than other algorithms.
Förderung
- Research & Innovation, Ministry of Education in Saudi Arabia
Zitieren
APA
Ali, Y., Awwad, E., Al-Razgan, M., & Maarouf, A. (2023). Hyperparameter Search for Machine Learning Algorithms for Optimizing the Computational Complexity. Processes, 11(2), 349. https://doi.org/10.3390/pr11020349
Vancouver
Ali Y, Awwad E, Al-Razgan M, Maarouf A. Hyperparameter Search for Machine Learning Algorithms for Optimizing the Computational Complexity. Processes. 2023;11(2):349. doi:10.3390/pr11020349
BibTeX
@article{Ali2023,
author = {Ali, Yasser and Awwad, Emad and Al-Razgan, Muna and Maarouf, Ali},
title = {Hyperparameter Search for Machine Learning Algorithms for Optimizing the Computational Complexity},
journal = {Processes},
year = {2023},
volume = {11},
number = {2},
pages = {349},
doi = {10.3390/pr11020349}
}
EUVIMED