Quantifying Information Stored in Synaptic Connections Rather Than in Firing Activities of Neural Networks
Neural Computation · 21.08.2026 · 38 (9) · 1545-1578
DOI: 10.1162/neco.a.1566 ↗Kurz gefasst
Fachartikel in der Zeitschrift Neural Computation, online erschienen am 21.08.2026. Verfasst von Xinhao Fan und 1 weiteren Autor:innen. Beteiligte Einrichtung: Solomon H. Snyder Department of Neuroscience, Johns Hopkins University, Baltimore, MD 21218, U.S.A. xfan20@jhu.edu. Hauptthemen laut MEDLINE: Synapses, Neural Networks, Computer, Neurons, Models, Neurological. Die Arbeit nennt 60 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: NEI NIH HHS.
Abstract (Originalsprache)
A cornerstone of our understanding of both biological and artificial neural networks is that they store information in the strengths of synaptic connections among the neurons. However, in contrast to the well-established theory for quantifying information encoded by the firing activity of neural networks, there does not exist a framework for quantifying information stored in the distribution of synaptic connection weights. Here, we develop a theoretical framework for synaptic information, by using densely connected Hebbian networks performing autoassociative memory tasks as the substrate, and by modeling data patterns that need to be stored as log-normal distributions. Specifically, we derive analytical approximations for Shannon mutual information between the data patterns and singletons, pairs, and arbitrary n-tuples of synaptic connections within the network. Our framework corroborates well-established insights regarding pattern storage capacity and the principle of distributed coding in neural firing activities. Notably, it formalizes the heterogeneity inherent in information encoding across synapses in a network, and discovers synergistic interactions among synapses, revealing that the information encoded jointly by all the synapses exceeds the sum of its parts. Taken together, this study introduces a powerful, interpretable framework for quantitatively understanding information storage in the synapses of neural networks, one that illustrates the duality of synaptic connectivity and neural population activity in learning and memory.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Solomon H. Snyder Department of Neuroscience, Johns Hopkins University, Baltimore, MD 21218, U.S.A. xfan20@jhu.edu.
- Department of Psychological and Brain Sciences, Johns Hopkins University; Solomon H. Snyder Department of Neuroscience, Johns Hopkins University; and Kavli Neuroscience Discovery Institute, Johns Hopkins University, Bal…
Förderung
- NEI NIH HHS
Zitieren
APA
Fan, X., & Mysore, S. P. (2026). Quantifying Information Stored in Synaptic Connections Rather Than in Firing Activities of Neural Networks. Neural Computation, 38(9), 1545-1578. https://doi.org/10.1162/neco.a.1566
Vancouver
Fan X, Mysore SP. Quantifying Information Stored in Synaptic Connections Rather Than in Firing Activities of Neural Networks. Neural Computation. 2026;38(9):1545-1578. doi:10.1162/neco.a.1566
BibTeX
@article{Fan2026,
author = {Fan, Xinhao and Mysore, Shreesh P},
title = {Quantifying Information Stored in Synaptic Connections Rather Than in Firing Activities of Neural Networks},
journal = {Neural Computation},
year = {2026},
volume = {38},
number = {9},
pages = {1545--1578},
doi = {10.1162/neco.a.1566}
}
EUVIMED