Hermite Structure And Spectral Properties Of Symmetric Gated Activation Functions
Gulf Journal of Mathematics · 20.07.2026 · 23 (2)
DOI: 10.56947/bs4wx079 ↗Kurz gefasst
Fachartikel in der Zeitschrift Gulf Journal of Mathematics, online erschienen am 20.07.2026. Verfasst von Chiheb Eddine Oualha und 1 weiteren Autor:innen.
Abstract (Originalsprache)
We study a family of self-gated functions where the gate satisfies a reflection symmetry, and this forces a rigid Hermite structure. We then specialize the abstract theory to the Swish and GELU families by proving strict monotonicity of the spectral ratio, and deriving both the small- and large-parameter asymptotic expansions. For GELU specifically, we also derive the exact closed form for the spectral ratio. We then enrich the symmetric family by adding odd perturbations and show that the leading Hermite mode becomes continuously controllable.
Zitieren
APA
Oualha, C. E., & Hadji, M. L. (2026). Hermite Structure And Spectral Properties Of Symmetric Gated Activation Functions. Gulf Journal of Mathematics, 23(2). https://doi.org/10.56947/bs4wx079
Vancouver
Oualha CE, Hadji ML. Hermite Structure And Spectral Properties Of Symmetric Gated Activation Functions. Gulf Journal of Mathematics. 2026;23(2). doi:10.56947/bs4wx079
BibTeX
@article{Oualha2026,
author = {Oualha, Chiheb Eddine and Hadji, Mohammed Lakhdar},
title = {Hermite Structure And Spectral Properties Of Symmetric Gated Activation Functions},
journal = {Gulf Journal of Mathematics},
year = {2026},
volume = {23},
number = {2},
doi = {10.56947/bs4wx079}
}
EUVIMED