EUVIMEDEUVIMED entdecken
Crossref

Echoes of the Past: A Unified Perspective on Fading Memory and Echo States

Juan-Pablo Ortega, Florian Rossmannek

Neural Computation · 30.04.2026 · 38 (5) · 765-782

DOI: 10.1162/neco.a.1510 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Neural Computation, online erschienen am 30.04.2026. Verfasst von Juan-Pablo Ortega und 1 weiteren Autor:innen. Beteiligte Einrichtung: Division of Mathematical Sciences, School of Physical and Mathematical Sciences, Nanyang Technological University, 637371 Singapore juan-pablo.ortega…. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 57 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Recurrent neural networks (RNNs) have become increasingly popular in information processing tasks involving time series and temporal data. A fundamental property of RNNs is their ability to create reliable input/output responses, often linked to how the network handles its memory of the information it processed. Various notions have been proposed to conceptualize the behavior of memory in RNNs, including steady states, echo states, state forgetting, input forgetting, and fading memory. Although these notions are often used interchangeably, their precise relationships remain unclear. This work aims to unify these notions in a common language, derive new implications and equivalences between them, and provide alternative proofs to some existing results. By clarifying the relationships between these concepts, this research contributes to a deeper understanding of RNNs and their temporal information processing capabilities.

Autor:innen und Institutionen

  • Division of Mathematical Sciences, School of Physical and Mathematical Sciences, Nanyang Technological University, 637371 Singapore juan-pablo.ortega@ntu.edu.sg.
  • Division of Mathematical Sciences, School of Physical and Mathematical Sciences, Nanyang Technological University, 637371 Singapore florian.rossmannek@ntu.edu.sg.

Zitieren

APA

Ortega, J. P., & Rossmannek, F. (2026). Echoes of the Past: A Unified Perspective on Fading Memory and Echo States. Neural Computation, 38(5), 765-782. https://doi.org/10.1162/neco.a.1510

Vancouver

Ortega JP, Rossmannek F. Echoes of the Past: A Unified Perspective on Fading Memory and Echo States. Neural Computation. 2026;38(5):765-782. doi:10.1162/neco.a.1510

BibTeX
@article{Ortega2026,
  author = {Ortega, Juan-Pablo and Rossmannek, Florian},
  title = {Echoes of the Past: A Unified Perspective on Fading Memory and Echo States},
  journal = {Neural Computation},
  year = {2026},
  volume = {38},
  number = {5},
  pages = {765--782},
  doi = {10.1162/neco.a.1510}
}
Kostenlos starten →