EUVIMEDEUVIMED entdecken
Crossref

Embedding Inequalities for Barron-Type Spaces

Lei Wu

Journal of Machine Learning · 2023

DOI: 10.4208/jml.230530 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Machine Learning, 2023. Verfasst von Lei Wu. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 26 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

An important problem in machine learning theory is to understand the approximation and generalization properties of two-layer neural networks in high dimensions. To this end, researchers have introduced the Barron space $\mathcal{B}_s(Ω)$ and the spectral Barron space $\mathcal{F}_s(Ω),$ where the index $s ∈ [0, ∞)$ indicates the smoothness of functions within these spaces and $Ω ⊂ \mathbb{R}^d$ denotes the input domain. However, the precise relationship between the two types of Barron spaces remains unclear. In this paper, we establish a continuous embedding between them as implied by the following inequality: For any $\delta∈ (0, 1),s ∈ \mathbb{N}^+$ and $f : Ω\mapsto \mathbb{R},$ it holds that $$\delta||f||_{\mathcal{F}_{s−\delta}(Ω)}\lesssim_s||f||_{\mathcal{B}_s(Ω)}\lesssim_s||f||_{\mathcal{F}_{s+1}(Ω).}$$ Importantly, the constants do not depend on the input dimension $d,$ suggesting that the embedding is effective in high dimensions. Moreover, we also show that the lower and upper bound are both tight.

Zitieren

APA

Wu, L. (2023). Embedding Inequalities for Barron-Type Spaces. Journal of Machine Learning. https://doi.org/10.4208/jml.230530

Vancouver

Wu L. Embedding Inequalities for Barron-Type Spaces. Journal of Machine Learning. 2023. doi:10.4208/jml.230530

BibTeX
@article{Wu2023,
  author = {Wu, Lei},
  title = {Embedding Inequalities for Barron-Type Spaces},
  journal = {Journal of Machine Learning},
  year = {2023},
  doi = {10.4208/jml.230530}
}
Kostenlos starten →