EUVIMEDEUVIMED entdecken
Crossref

Approximation Results for Gradient Flow Trained Neural Networks

Gerrit Welper

Journal of Machine Learning · 2024

DOI: 10.4208/jml.230924 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Machine Learning, 2024. Verfasst von Gerrit Welper. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 76 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The paper contains approximation guarantees for neural networks that are trained with gradient flow, with error measured in the continuous $L_2(\mathbb{S}^{d−1 )}$-norm on the $d$-dimensional unit sphere and targets that are Sobolev smooth. The networks are fully connected of constant depth and increasing width. We show gradient flow convergence based on a neural tangent kernel (NTK) argument for the non-convex optimization of the second but last layer. Unlike standard NTK analysis, the continuous error norm implies an under-parametrized regime, possible by the natural smoothness assumption required for approximation. The typical over-parametrization re-enters the results in form of a loss in approximation rate relative to established approximation methods for Sobolev smooth functions.

Zitieren

APA

Welper, G. (2024). Approximation Results for Gradient Flow Trained Neural Networks. Journal of Machine Learning. https://doi.org/10.4208/jml.230924

Vancouver

Welper G. Approximation Results for Gradient Flow Trained Neural Networks. Journal of Machine Learning. 2024. doi:10.4208/jml.230924

BibTeX
@article{Welper2024,
  author = {Welper, Gerrit},
  title = {Approximation Results for Gradient Flow Trained Neural Networks},
  journal = {Journal of Machine Learning},
  year = {2024},
  doi = {10.4208/jml.230924}
}
Kostenlos starten →