EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Synergistic information supports modality integration and flexible learning in neural networks solving multiple tasks

Alexandra M Proca iD, Fernando E Rosas, Andrea I Luppi, Daniel Bor, Matthew Crosby, Pedro A M Mediano

PLOS Computational Biology · 2024

DOI: 10.1371/journal.pcbi.1012178 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS Computational Biology, 2024. Verfasst von Alexandra M Proca und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Computing, Imperial College London, London, United Kingdom. Hauptthemen laut MEDLINE: Neural Networks, Computer, Learning, Cognition, Brain. Die Arbeit wurde bisher 29-mal zitiert (Crossref) und nennt 76 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Wellcome Trust, Imperial College London, Ad Astra Chandaria Foundation.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Striking progress has been made in understanding cognition by analyzing how the brain is engaged in different modes of information processing. For instance, so-called synergistic information (information encoded by a set of neurons but not by any subset) plays a key role in areas of the human brain linked with complex cognition. However, two questions remain unanswered: (a) how and why a cognitive system can become highly synergistic; and (b) how informational states map onto artificial neural networks in various learning modes. Here we employ an information-decomposition framework to investigate neural networks performing cognitive tasks. Our results show that synergy increases as networks learn multiple diverse tasks, and that in tasks requiring integration of multiple sources, performance critically relies on synergistic neurons. Overall, our results suggest that synergy is used to combine information from multiple modalities—and more generally for flexible and efficient learning. These findings reveal new ways of investigating how and why learning systems employ specific information-processing strategies, and support the principle that the capacity for general-purpose learning critically relies on the system’s information dynamics.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Neural Networks, ComputerLearningCognitionBrainModels, NeurologicalHumansComputational BiologyNeurons

Autor:innen und Institutionen

  • Department of Computing, Imperial College London, London, United Kingdom.
  • Department of Informatics, University of Sussex, Brighton, United Kingdom.
  • Sussex Centre for Consciousness Science and Sussex AI, University of Sussex, Brighton, United Kingdom.
  • Centre for Psychedelic Research and Centre for Complexity Science, Department of Brain Sciences, Imperial College London, London, United Kingdom.
  • Centre for Eudaimonia and Human Flourishing, University of Oxford, Oxford, United Kingdom.
  • Department of Clinical Neurosciences and Division of Anaesthesia, University of Cambridge, Cambridge, United Kingdom.

ORCID-Profile: Alexandra M Proca

Förderung

  • Wellcome Trust
  • Imperial College London
  • Ad Astra Chandaria Foundation
  • Gates Cambridge Trust

Zitieren

APA

Proca, A. M., Rosas, F. E., Luppi, A. I., Bor, D., Crosby, M., & Mediano, P. A. M. (2024). Synergistic information supports modality integration and flexible learning in neural networks solving multiple tasks. PLOS Computational Biology. https://doi.org/10.1371/journal.pcbi.1012178

Vancouver

Proca AM, Rosas FE, Luppi AI, Bor D, Crosby M, Mediano PAM. Synergistic information supports modality integration and flexible learning in neural networks solving multiple tasks. PLOS Computational Biology. 2024. doi:10.1371/journal.pcbi.1012178

BibTeX
@article{Proca2024,
  author = {Proca, Alexandra M and Rosas, Fernando E and Luppi, Andrea I and Bor, Daniel and Crosby, Matthew and Mediano, Pedro A M},
  title = {Synergistic information supports modality integration and flexible learning in neural networks solving multiple tasks},
  journal = {PLOS Computational Biology},
  year = {2024},
  doi = {10.1371/journal.pcbi.1012178}
}
Kostenlos starten →