EUVIMEDEUVIMED entdecken
Crossref

A Stochastic Trust Region Algorithm Based on Careful Step Normalization

Frank E. Curtis, Katya Scheinberg, Rui Shi

INFORMS Journal on Optimization · 2019

DOI: 10.1287/ijoo.2018.0010 ↗

Kurz gefasst

Fachartikel in der Zeitschrift INFORMS Journal on Optimization, 2019. Verfasst von Frank E. Curtis und 2 weiteren Autor:innen. Die Arbeit wurde bisher 39-mal zitiert (Crossref) und nennt 30 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

An algorithm is proposed for solving stochastic and finite-sum minimization problems. Based on a trust region methodology, the algorithm employs normalized steps, at least as long as the norms of the stochastic gradient estimates are within a specified interval. The complete algorithm—which dynamically chooses whether to employ normalized steps—is proved to have convergence guarantees that are similar to those possessed by a traditional stochastic gradient approach under various sets of conditions related to the accuracy of the stochastic gradient estimates and choice of step size sequence. The results of numerical experiments where the method is employed to minimize convex and nonconvex machine learning test problems are presented. These results illustrate that the method can outperform a traditional stochastic gradient approach.

Zitieren

APA

Curtis, F. E., Scheinberg, K., & Shi, R. (2019). A Stochastic Trust Region Algorithm Based on Careful Step Normalization. INFORMS Journal on Optimization. https://doi.org/10.1287/ijoo.2018.0010

Vancouver

Curtis FE, Scheinberg K, Shi R. A Stochastic Trust Region Algorithm Based on Careful Step Normalization. INFORMS Journal on Optimization. 2019. doi:10.1287/ijoo.2018.0010

BibTeX
@article{Curtis2019,
  author = {Curtis, Frank E. and Scheinberg, Katya and Shi, Rui},
  title = {A Stochastic Trust Region Algorithm Based on Careful Step Normalization},
  journal = {INFORMS Journal on Optimization},
  year = {2019},
  doi = {10.1287/ijoo.2018.0010}
}
Kostenlos starten →