Cracking the neural code for word recognition in convolutional neural networks
PLOS Computational Biology · 06.09.2024 · 20 (9) · e1012430
DOI: 10.1371/journal.pcbi.1012430 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS Computational Biology, online erschienen am 06.09.2024. Verfasst von Aakash Agrawal und 1 weiteren Autor:innen. Beteiligte Einrichtung: Cognitive Neuroimaging Unit, CEA, INSERM U 992, Université Paris-Saclay, NeuroSpin center, Gif/Yvette, France. Hauptthemen laut MEDLINE: Neural Networks, Computer, Reading. Die Arbeit wurde bisher 20-mal zitiert (Crossref) und nennt 65 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Paris Region fellowship Programme, “TOPLEX” ANR program, H2020 Marie Skłodowska-Curie Actions.
Abstract (Originalsprache)
Learning to read places a strong challenge on the visual system. Years of expertise lead to a remarkable capacity to separate similar letters and encode their relative positions, thus distinguishing words such as FORM and FROM, invariantly over a large range of positions, sizes and fonts. How neural circuits achieve invariant word recognition remains unknown. Here, we address this issue by recycling deep neural network models initially trained for image recognition. We retrain them to recognize written words and then analyze how reading-specialized units emerge and operate across the successive layers. With literacy, a small subset of units becomes specialized for word recognition in the learned script, similar to the visual word form area (VWFA) in the human brain. We show that these units are sensitive to specific letter identities and their ordinal position from the left or the right of a word. The transition from retinotopic to ordinal position coding is achieved by a hierarchy of “space bigram” unit that detect the position of a letter relative to a blank space and that pool across low- and high-frequency-sensitive units from early layers of the network. The proposed scheme provides a plausible neural code for written words in the VWFA, and leads to predictions for reading behavior, error patterns, and the neurophysiology of reading.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Cognitive Neuroimaging Unit, CEA, INSERM U 992, Université Paris-Saclay, NeuroSpin center, Gif/Yvette, France.
- Collège de France, Université Paris Sciences Lettres (PSL), Paris, France.
ORCID-Profile: Aakash Agrawal
Förderung
- Paris Region fellowship Programme
- “TOPLEX” ANR program
- H2020 Marie Skłodowska-Curie Actions
Zitieren
APA
Agrawal, A., & Dehaene, S. (2024). Cracking the neural code for word recognition in convolutional neural networks. PLOS Computational Biology, 20(9), e1012430. https://doi.org/10.1371/journal.pcbi.1012430
Vancouver
Agrawal A, Dehaene S. Cracking the neural code for word recognition in convolutional neural networks. PLOS Computational Biology. 2024;20(9):e1012430. doi:10.1371/journal.pcbi.1012430
BibTeX
@article{Agrawal2024,
author = {Agrawal, Aakash and Dehaene, Stanislas},
title = {Cracking the neural code for word recognition in convolutional neural networks},
journal = {PLOS Computational Biology},
year = {2024},
volume = {20},
number = {9},
pages = {e1012430},
doi = {10.1371/journal.pcbi.1012430}
}
EUVIMED