Recent Advances in Optimization Methods for Machine Learning: A Systematic Review
Mathematics · 07.07.2025 · 13 (13) · 2210
DOI: 10.3390/math13132210 ↗Kurz gefasst
Systematische Übersicht in der Zeitschrift Mathematics, online erschienen am 07.07.2025. Verfasst von Xiaodong Liu und 4 weiteren Autor:innen. Die Arbeit wurde bisher 51-mal zitiert (Crossref) und nennt 87 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Open Project Program of State Key Laboratory of Virtual Reality Technology and Systems, Beihang University, China, Opening Project of Guangdong Province Key Laboratory of Computational Science at the Sun Yat-sen University, China.
Abstract (Originalsprache)
This systematic review explores modern optimization methods for machine learning, distinguishing between gradient-based techniques using derivative information and population-based approaches employing stochastic search. Key innovations focus on enhanced regularization, adaptive control mechanisms, and biologically inspired strategies to address challenges like scaling to large models, navigating complex non-convex landscapes, and adapting to dynamic constraints. These methods underpin core ML tasks including model training, hyperparameter tuning, and feature selection. While significant progress is evident, limitations in scalability and theoretical guarantees persist, directing future work toward more robust and adaptive frameworks to advance AI applications in areas like autonomous systems and scientific discovery.
Förderung
- National Natural Science Foundation of China
- Open Project Program of State Key Laboratory of Virtual Reality Technology and Systems, Beihang University, China
- Opening Project of Guangdong Province Key Laboratory of Computational Science at the Sun Yat-sen University, China
- Xidian University Specially Funded Project for Interdisciplinary Exploration, China
- Fundamental Research Funds for the Central Universities, China
Zitieren
APA
Liu, X., Qi, H., Jia, S., Guo, Y., & Liu, Y. (2025). Recent Advances in Optimization Methods for Machine Learning: A Systematic Review. Mathematics, 13(13), 2210. https://doi.org/10.3390/math13132210
Vancouver
Liu X, Qi H, Jia S, Guo Y, Liu Y. Recent Advances in Optimization Methods for Machine Learning: A Systematic Review. Mathematics. 2025;13(13):2210. doi:10.3390/math13132210
BibTeX
@article{Liu2025,
author = {Liu, Xiaodong and Qi, Huaizhou and Jia, Suisui and Guo, Yongjing and Liu, Yang},
title = {Recent Advances in Optimization Methods for Machine Learning: A Systematic Review},
journal = {Mathematics},
year = {2025},
volume = {13},
number = {13},
pages = {2210},
doi = {10.3390/math13132210}
}
EUVIMED