EUVIMEDEUVIMED entdecken
Crossref

Function Space and Critical Points of Linear Convolutional Networks

Kathlén Kohn, Guido Montúfar, Vahid Shahverdi, Matthew Trager

SIAM Journal on Applied Algebra and Geometry · 30.06.2024 · 8 (2) · 333-362

DOI: 10.1137/23m1565504 ↗

Kurz gefasst

Fachartikel in der Zeitschrift SIAM Journal on Applied Algebra and Geometry, online erschienen am 21.05.2024. Verfasst von Kathlén Kohn und 3 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 23 Literaturangaben. Gefördert von: Deutsche Forschungsgemeinschaft SPP 2298, European Research Council (ERC) Starting Grant, Bundesministerium für Bildung und Forschung.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

We study the geometry of linear networks with one-dimensional convolutional layers. The function spaces of these networks can be identified with semialgebraic families of polynomials admitting sparse factorizations. We analyze the impact of the network’s architecture on the function space’s dimension, boundary, and singular points. We also describe the critical points of the network’s parameterization map. Furthermore, we study the optimization problem of training a network with the squared error loss. We prove that for architectures where all strides are larger than one and generic data, the nonzero critical points of that optimization problem are smooth interior points of the function space. This property is known to be false for dense linear networks and linear convolutional networks with stride one.

Förderung

  • Deutsche Forschungsgemeinschaft SPP 2298
  • European Research Council (ERC) Starting Grant
  • Bundesministerium für Bildung und Forschung
  • Knut och Alice Wallenbergs Stiftelse
  • National Science Foundation

Zitieren

APA

Kohn, K., Montúfar, G., Shahverdi, V., & Trager, M. (2024). Function Space and Critical Points of Linear Convolutional Networks. SIAM Journal on Applied Algebra and Geometry, 8(2), 333-362. https://doi.org/10.1137/23m1565504

Vancouver

Kohn K, Montúfar G, Shahverdi V, Trager M. Function Space and Critical Points of Linear Convolutional Networks. SIAM Journal on Applied Algebra and Geometry. 2024;8(2):333-362. doi:10.1137/23m1565504

BibTeX
@article{Kohn2024,
  author = {Kohn, Kathlén and Montúfar, Guido and Shahverdi, Vahid and Trager, Matthew},
  title = {Function Space and Critical Points of Linear Convolutional Networks},
  journal = {SIAM Journal on Applied Algebra and Geometry},
  year = {2024},
  volume = {8},
  number = {2},
  pages = {333--362},
  doi = {10.1137/23m1565504}
}
Kostenlos starten →