EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

How well do models of visual cortex generalize to out of distribution samples?

Yifei Ren, Pouya Bashivan iD

PLOS Computational Biology · 2024

DOI: 10.1371/journal.pcbi.1011145 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS Computational Biology, 2024. Verfasst von Yifei Ren und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Computer Science, McGill University, Montreal, Canada. Hauptthemen laut MEDLINE: Visual Cortex, Models, Neurological, Neural Networks, Computer, Computational Biology. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 63 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Healthy-Brains-Healthy-Lives startup supplement grant, Natural Sciences and Engineering Research Council of Canada, FRQ-S Research Scholars Junior 1.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Unit activity in particular deep neural networks (DNNs) are remarkably similar to the neuronal population responses to static images along the primate ventral visual cortex. Linear combinations of DNN unit activities are widely used to build predictive models of neuronal activity in the visual cortex. Nevertheless, prediction performance in these models is often investigated on stimulus sets consisting of everyday objects under naturalistic settings. Recent work has revealed a generalization gap in how predicting neuronal responses to synthetically generated out-of-distribution (OOD) stimuli. Here, we investigated how the recent progress in improving DNNs’ object recognition generalization, as well as various DNN design choices such as architecture, learning algorithm, and datasets have impacted the generalization gap in neural predictivity. We came to a surprising conclusion that the performance on none of the common computer vision OOD object recognition benchmarks is predictive of OOD neural predictivity performance. Furthermore, we found that adversarially robust models often yield substantially higher generalization in neural predictivity, although the degree of robustness itself was not predictive of neural predictivity score. These results suggest that improving object recognition behavior on current benchmarks alone may not lead to more general models of neurons in the primate ventral visual cortex.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Visual CortexModels, NeurologicalNeural Networks, ComputerComputational BiologyAnimalsAlgorithmsNeuronsHumansPhotic Stimulation

Autor:innen und Institutionen

  • Department of Computer Science, McGill University, Montreal, Canada.
  • Department of Computer Physiology, McGill University, Montreal, Canada.
  • Mila, Université de Montréal, Montreal, Canada.

ORCID-Profile: Pouya Bashivan

Förderung

  • Healthy-Brains-Healthy-Lives startup supplement grant
  • Natural Sciences and Engineering Research Council of Canada
  • FRQ-S Research Scholars Junior 1
  • William Dawson Scholar Award

Zitieren

APA

Ren, Y., & Bashivan, P. (2024). How well do models of visual cortex generalize to out of distribution samples?. PLOS Computational Biology. https://doi.org/10.1371/journal.pcbi.1011145

Vancouver

Ren Y, Bashivan P. How well do models of visual cortex generalize to out of distribution samples?. PLOS Computational Biology. 2024. doi:10.1371/journal.pcbi.1011145

BibTeX
@article{Ren2024,
  author = {Ren, Yifei and Bashivan, Pouya},
  title = {How well do models of visual cortex generalize to out of distribution samples?},
  journal = {PLOS Computational Biology},
  year = {2024},
  doi = {10.1371/journal.pcbi.1011145}
}
Kostenlos starten →