Convolutional networks can model the functional modulation of the MEG responses associated with feed-forward processes during visual word recognition
eLife · 2025
DOI: 10.7554/elife.96217 ↗Kurz gefasst
Fachartikel in der Zeitschrift eLife, 2025. Verfasst von Marijn van Vliet und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Neuroscience and Biomedical Engineering, Aalto University, Espoo, Finland. Hauptthemen laut MEDLINE: Magnetoencephalography, Reading, Neural Networks, Computer, Pattern Recognition, Visual. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 93 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Research Council of Finland, Sigrid Juséliuksen Säätiö.
Abstract (Originalsprache)
Traditional models of reading lack a realistic simulation of the early visual processing stages, taking input in the form of letter banks and predefined line segments, making them unsuitable for modeling early brain responses. We used variations of the VGG-11 convolutional neural network (CNN) to create models of visual word recognition that starts from the pixel-level and performs the macro-scale computations needed for the detection and segmentation of letter shapes to word-form identification of large vocabulary of 10k Finnish words, regardless of letter size, shape, or rotation. The models were evaluated based on an existing magnetoencephalography (MEG) study where participants viewed regular words, pseudowords, noise-embedded words, symbol strings, and consonant strings. The original images used in the study were presented to the models and the activity in the layers was compared to MEG evoked response amplitudes. Through a few alterations to make the network more biologically plausible, we found an CNN architecture that can correctly simulate the behavior of three prominent responses, namely the type I (early visual response), type II (the ‘letter string’ response), and the N400m. In conclusion, starting a model of reading with convolution-and-pooling steps enables the flexibility and realism crucial for a direct model-to-brain comparison.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Neuroscience and Biomedical Engineering, Aalto University, Espoo, Finland.
- School of Electronics, Electrical Engineering and Computer Science, Queen's University Belfast, Belfast, United Kingdom.
- Aalto NeuroImaging, Aalto University, Espo, Finland.
ORCID-Profile: Marijn van Vliet, Riitta Salmelin
Förderung
- Research Council of Finland
- Sigrid Juséliuksen Säätiö
Zitieren
APA
van Vliet, M., Rinkinen, O., Shimizu, T., Niskanen, A. M., Devereux, B., & Salmelin, R. (2025). Convolutional networks can model the functional modulation of the MEG responses associated with feed-forward processes during visual word recognition. eLife. https://doi.org/10.7554/elife.96217
Vancouver
van Vliet M, Rinkinen O, Shimizu T, Niskanen AM, Devereux B, Salmelin R. Convolutional networks can model the functional modulation of the MEG responses associated with feed-forward processes during visual word recognition. eLife. 2025. doi:10.7554/elife.96217
BibTeX
@article{vanVliet2025,
author = {van Vliet, Marijn and Rinkinen, Oona and Shimizu, Takao and Niskanen, Anni-Mari and Devereux, Barry and Salmelin, Riitta},
title = {Convolutional networks can model the functional modulation of the MEG responses associated with feed-forward processes during visual word recognition},
journal = {eLife},
year = {2025},
doi = {10.7554/elife.96217}
}
EUVIMED