Synergistic information supports modality integration and flexible learning in neural networks solving multiple tasks
PLOS Computational Biology · 2024
DOI: 10.1371/journal.pcbi.1012178 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS Computational Biology, 2024. Verfasst von Alexandra M Proca und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Computing, Imperial College London, London, United Kingdom. Hauptthemen laut MEDLINE: Neural Networks, Computer, Learning, Cognition, Brain. Die Arbeit wurde bisher 29-mal zitiert (Crossref) und nennt 76 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Wellcome Trust, Imperial College London, Ad Astra Chandaria Foundation.
Abstract (Originalsprache)
Striking progress has been made in understanding cognition by analyzing how the brain is engaged in different modes of information processing. For instance, so-called synergistic information (information encoded by a set of neurons but not by any subset) plays a key role in areas of the human brain linked with complex cognition. However, two questions remain unanswered: (a) how and why a cognitive system can become highly synergistic; and (b) how informational states map onto artificial neural networks in various learning modes. Here we employ an information-decomposition framework to investigate neural networks performing cognitive tasks. Our results show that synergy increases as networks learn multiple diverse tasks, and that in tasks requiring integration of multiple sources, performance critically relies on synergistic neurons. Overall, our results suggest that synergy is used to combine information from multiple modalities—and more generally for flexible and efficient learning. These findings reveal new ways of investigating how and why learning systems employ specific information-processing strategies, and support the principle that the capacity for general-purpose learning critically relies on the system’s information dynamics.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Department of Computing, Imperial College London, London, United Kingdom.
- Department of Informatics, University of Sussex, Brighton, United Kingdom.
- Sussex Centre for Consciousness Science and Sussex AI, University of Sussex, Brighton, United Kingdom.
- Centre for Psychedelic Research and Centre for Complexity Science, Department of Brain Sciences, Imperial College London, London, United Kingdom.
- Centre for Eudaimonia and Human Flourishing, University of Oxford, Oxford, United Kingdom.
- Department of Clinical Neurosciences and Division of Anaesthesia, University of Cambridge, Cambridge, United Kingdom.
ORCID-Profile: Alexandra M Proca
Förderung
- Wellcome Trust
- Imperial College London
- Ad Astra Chandaria Foundation
- Gates Cambridge Trust
Zitieren
APA
Proca, A. M., Rosas, F. E., Luppi, A. I., Bor, D., Crosby, M., & Mediano, P. A. M. (2024). Synergistic information supports modality integration and flexible learning in neural networks solving multiple tasks. PLOS Computational Biology. https://doi.org/10.1371/journal.pcbi.1012178
Vancouver
Proca AM, Rosas FE, Luppi AI, Bor D, Crosby M, Mediano PAM. Synergistic information supports modality integration and flexible learning in neural networks solving multiple tasks. PLOS Computational Biology. 2024. doi:10.1371/journal.pcbi.1012178
BibTeX
@article{Proca2024,
author = {Proca, Alexandra M and Rosas, Fernando E and Luppi, Andrea I and Bor, Daniel and Crosby, Matthew and Mediano, Pedro A M},
title = {Synergistic information supports modality integration and flexible learning in neural networks solving multiple tasks},
journal = {PLOS Computational Biology},
year = {2024},
doi = {10.1371/journal.pcbi.1012178}
}
EUVIMED