EUVIMEDAtrasti EUVIMED
Open access · CC BY 4.0

Emergence of Memory and Program via Functional Differentiation in Evolutionary Echo State Networks with Complexity Indices

Hiroshi Watanabe, Ichiro Tsuda

Complexities · 2026-05-28 · 2 (2) · 14

DOI: 10.3390/complexities2020014 ↗

At a glance

Journal article in Complexities, published online on 2026-05-28. Written by Hiroshi Watanabe and 1 co-authors. 23 references. The full text is freely available (open access, CC BY 4.0). Funded by: Japan Science and Technology Agency, MEXT/JSPS KAKENHI, Sapporo City University.

SantraukaBibliografiniai duomenysCiteRelated studies

Abstract (original language)

In the context of Kolmogorov complexity, the complexity of an object can be characterized by the length of the shortest algorithm required to describe or compute it. In condensed matter systems under equilibrium and nonequilibrium conditions, macroscopic properties distinct from elementary ones can emerge from large numbers of particles. Such a large system size allows system properties to change as control parameters change, producing phase transitions. Inspired by this analogy, it is natural to consider that an optimized computing system may undergo a transition from an initially random organization to a functionally organized state. In this paper, by adopting a specific multi-task setting based on a typical dynamical system, we propose an evolutionary echo state network that realizes the functional differentiation of a random neural network into two subnetworks—one specialized for memory and the other for program execution. The model suggests a minimal neural mechanism for dynamic processes that extract rules embedded in input sequences and store information over short or long time scales. Because the proposed evolutionary model is driven by constraints that jointly reduce task errors and structural redundancy, the resulting network can be regarded as an optimized descriptor of memory and program functions. To clarify the relationship between the proposed model and algorithmic complexity, we introduce Lempel–Ziv-based complexity indices for both network structure and node-wise reservoir dynamics. Although neither density, effective spectral radius, nor the Lempel–Ziv-based complexity indices were prescribed or optimized in the eESN, the evolved network exhibited structural complexity comparable to conventional ESNs in the corresponding region and slightly higher dynamical complexity. These results suggest that the advantage of eESN is not attributable to a direct maximization of complexity itself, but rather to the evolutionary organization of complexity into a functionally differentiated reservoir that supports both memory-like retention and program-like rule extraction.

Funding

  • Japan Science and Technology Agency
  • MEXT/JSPS KAKENHI
  • Sapporo City University

Cite

APA

Watanabe, H., & Tsuda, I. (2026). Emergence of Memory and Program via Functional Differentiation in Evolutionary Echo State Networks with Complexity Indices. Complexities, 2(2), 14. https://doi.org/10.3390/complexities2020014

Vancouver

Watanabe H, Tsuda I. Emergence of Memory and Program via Functional Differentiation in Evolutionary Echo State Networks with Complexity Indices. Complexities. 2026;2(2):14. doi:10.3390/complexities2020014

BibTeX
@article{Watanabe2026,
  author = {Watanabe, Hiroshi and Tsuda, Ichiro},
  title = {Emergence of Memory and Program via Functional Differentiation in Evolutionary Echo State Networks with Complexity Indices},
  journal = {Complexities},
  year = {2026},
  volume = {2},
  number = {2},
  pages = {14},
  doi = {10.3390/complexities2020014}
}
Start for free →