EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Convolutional networks can model the functional modulation of the MEG responses associated with feed-forward processes during visual word recognition

Marijn van Vliet iD, Oona Rinkinen, Takao Shimizu, Anni-Mari Niskanen, Barry Devereux, Riitta Salmelin iD

eLife · 2025

DOI: 10.7554/elife.96217 ↗

Kurz gefasst

Fachartikel in der Zeitschrift eLife, 2025. Verfasst von Marijn van Vliet und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Neuroscience and Biomedical Engineering, Aalto University, Espoo, Finland. Hauptthemen laut MEDLINE: Magnetoencephalography, Reading, Neural Networks, Computer, Pattern Recognition, Visual. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 93 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Research Council of Finland, Sigrid Juséliuksen Säätiö.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Traditional models of reading lack a realistic simulation of the early visual processing stages, taking input in the form of letter banks and predefined line segments, making them unsuitable for modeling early brain responses. We used variations of the VGG-11 convolutional neural network (CNN) to create models of visual word recognition that starts from the pixel-level and performs the macro-scale computations needed for the detection and segmentation of letter shapes to word-form identification of large vocabulary of 10k Finnish words, regardless of letter size, shape, or rotation. The models were evaluated based on an existing magnetoencephalography (MEG) study where participants viewed regular words, pseudowords, noise-embedded words, symbol strings, and consonant strings. The original images used in the study were presented to the models and the activity in the layers was compared to MEG evoked response amplitudes. Through a few alterations to make the network more biologically plausible, we found an CNN architecture that can correctly simulate the behavior of three prominent responses, namely the type I (early visual response), type II (the ‘letter string’ response), and the N400m. In conclusion, starting a model of reading with convolution-and-pooling steps enables the flexibility and realism crucial for a direct model-to-brain comparison.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

MagnetoencephalographyReadingNeural Networks, ComputerPattern Recognition, VisualBrainHumansAdultMaleFemaleYoung AdultModels, Neurological

Stichwörter der Autor:innen

computational modelingevoked potentialshumanmagnetoencephalographyneurosciencereading

Autor:innen und Institutionen

  • Department of Neuroscience and Biomedical Engineering, Aalto University, Espoo, Finland.
  • School of Electronics, Electrical Engineering and Computer Science, Queen's University Belfast, Belfast, United Kingdom.
  • Aalto NeuroImaging, Aalto University, Espo, Finland.

ORCID-Profile: Marijn van Vliet, Riitta Salmelin

Förderung

  • Research Council of Finland
  • Sigrid Juséliuksen Säätiö

Zitieren

APA

van Vliet, M., Rinkinen, O., Shimizu, T., Niskanen, A. M., Devereux, B., & Salmelin, R. (2025). Convolutional networks can model the functional modulation of the MEG responses associated with feed-forward processes during visual word recognition. eLife. https://doi.org/10.7554/elife.96217

Vancouver

van Vliet M, Rinkinen O, Shimizu T, Niskanen AM, Devereux B, Salmelin R. Convolutional networks can model the functional modulation of the MEG responses associated with feed-forward processes during visual word recognition. eLife. 2025. doi:10.7554/elife.96217

BibTeX
@article{vanVliet2025,
  author = {van Vliet, Marijn and Rinkinen, Oona and Shimizu, Takao and Niskanen, Anni-Mari and Devereux, Barry and Salmelin, Riitta},
  title = {Convolutional networks can model the functional modulation of the MEG responses associated with feed-forward processes during visual word recognition},
  journal = {eLife},
  year = {2025},
  doi = {10.7554/elife.96217}
}
Kostenlos starten →