Suppression of chaos in a partially driven recurrent neural network
Physical Review Research · 16.02.2024 · 6 (1)
DOI: 10.1103/physrevresearch.6.013172 ↗Kurz gefasst
Fachartikel in der Zeitschrift Physical Review Research, online erschienen am 16.02.2024. Verfasst von Shotaro Takasu und 1 weiteren Autor:innen. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 23 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Japan Society for the Promotion of Science.
Abstract (Originalsprache)
The dynamics of recurrent neural networks (RNNs), and particularly their response to inputs, play a critical role in information processing. In many applications of RNNs, only a specific subset of the neurons generally receive inputs. However, it remains to be theoretically clarified how the restriction of the input to a specific subset of neurons affects the network dynamics. Considering RNNs with such restricted input, we investigate how the proportion, p , of the neurons receiving inputs (the “input neurons”) and the strength of the input signals affect the dynamics by analytically deriving the conditional maximum Lyapunov exponent. Our results show that for sufficiently large p , the maximum Lyapunov exponent decreases monotonically as a function of the input strength, indicating the suppression of chaos, but if p is smaller than a critical threshold, p c , even significantly amplified inputs cannot suppress spontaneous chaotic dynamics. Furthermore, although the value of p c is seemingly dependent on several model parameters, such as the sparseness and strength of recurrent connections, it is proved to be intrinsically determined solely by the strength of chaos in spontaneous activity of the RNN. This is to say, despite changes in these model parameters, it is possible to represent the value of p c as a common invariant function by appropriately scaling these parameters to yield the same strength of spontaneous chaos. Our study suggests that if p is above p c , we can bring the neural network to the edge of chaos, thereby maximizing its information processing capacity, by amplifying inputs. Published by the American Physical Society 2024
Förderung
- Japan Society for the Promotion of Science
Zitieren
APA
Takasu, S., & Aoyagi, T. (2024). Suppression of chaos in a partially driven recurrent neural network. Physical Review Research, 6(1). https://doi.org/10.1103/physrevresearch.6.013172
Vancouver
Takasu S, Aoyagi T. Suppression of chaos in a partially driven recurrent neural network. Physical Review Research. 2024;6(1). doi:10.1103/physrevresearch.6.013172
BibTeX
@article{Takasu2024,
author = {Takasu, Shotaro and Aoyagi, Toshio},
title = {Suppression of chaos in a partially driven recurrent neural network},
journal = {Physical Review Research},
year = {2024},
volume = {6},
number = {1},
doi = {10.1103/physrevresearch.6.013172}
}
EUVIMED