Sharp Bounds for the Number of Regions of Maxout Networks and Vertices of Minkowski Sums
SIAM Journal on Applied Algebra and Geometry · 31.12.2022 · 6 (4) · 618-649
DOI: 10.1137/21m1413699 ↗Kurz gefasst
Fachartikel in der Zeitschrift SIAM Journal on Applied Algebra and Geometry, online erschienen am 16.12.2022. Verfasst von Guido Montúfar und 2 weiteren Autor:innen. Die Arbeit wurde bisher 21-mal zitiert (Crossref) und nennt 59 Literaturangaben. Gefördert von: Horizon 2020 Framework Programme, UK Research and Innovation.
Abstract (Originalsprache)
We present results on the number of linear regions of the functions that can be represented by artificial feedforward neural networks with maxout units. A rank-[Formula: see text] maxout unit is a function computing the maximum of [Formula: see text] linear functions. For networks with a single layer of maxout units, the linear regions correspond to the upper vertices of a Minkowski sum of polytopes. We obtain face counting formulas in terms of the intersection posets of tropical hypersurfaces or the number of upper faces of partial Minkowski sums, along with explicit sharp upper bounds for the number of regions for any input dimension, any number of units, and any ranks, in cases with and without biases. Based on these results we also obtain asymptotically sharp upper bounds for networks with multiple layers.
Förderung
- Horizon 2020 Framework Programme
- UK Research and Innovation
Zitieren
APA
Montúfar, G., Ren, Y., & Zhang, L. (2022). Sharp Bounds for the Number of Regions of Maxout Networks and Vertices of Minkowski Sums. SIAM Journal on Applied Algebra and Geometry, 6(4), 618-649. https://doi.org/10.1137/21m1413699
Vancouver
Montúfar G, Ren Y, Zhang L. Sharp Bounds for the Number of Regions of Maxout Networks and Vertices of Minkowski Sums. SIAM Journal on Applied Algebra and Geometry. 2022;6(4):618-649. doi:10.1137/21m1413699
BibTeX
@article{Montfar2022,
author = {Montúfar, Guido and Ren, Yue and Zhang, Leon},
title = {Sharp Bounds for the Number of Regions of Maxout Networks and Vertices of Minkowski Sums},
journal = {SIAM Journal on Applied Algebra and Geometry},
year = {2022},
volume = {6},
number = {4},
pages = {618--649},
doi = {10.1137/21m1413699}
}
EUVIMED