EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Diverse task-driven modeling of macaque V4 reveals functional specialization towards semantic tasks

Santiago A Cadena iD, Konstantin F Willeke, Kelli Restivo, George Denfield, Fabian H Sinz, Matthias Bethge, Andreas S Tolias, Alexander S Ecker

PLOS Computational Biology · 23.05.2024 · 20 (5) · e1012056

DOI: 10.1371/journal.pcbi.1012056 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS Computational Biology, online erschienen am 23.05.2024. Verfasst von Santiago A Cadena und 7 weiteren Autor:innen. Beteiligte Einrichtung: Institute of Computer Science and Campus Institute Data Science, University of Göttingen, Göttingen, Germany. Hauptthemen laut MEDLINE: Semantics, Neural Networks, Computer, Visual Cortex, Models, Neurological. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 83 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NIGMS NIH HHS, NIH HHS, NEI NIH HHS.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Responses to natural stimuli in area V4—a mid-level area of the visual ventral stream—are well predicted by features from convolutional neural networks (CNNs) trained on image classification. This result has been taken as evidence for the functional role of V4 in object classification. However, we currently do not know if and to what extent V4 plays a role in solving other computational objectives. Here, we investigated normative accounts of V4 (and V1 for comparison) by predicting macaque single-neuron responses to natural images from the representations extracted by 23 CNNs trained on different computer vision tasks including semantic, geometric, 2D, and 3D types of tasks. We found that V4 was best predicted by semantic classification features and exhibited high task selectivity, while the choice of task was less consequential to V1 performance. Consistent with traditional characterizations of V4 function that show its high-dimensional tuning to various 2D and 3D stimulus directions, we found that diverse non-semantic tasks explained aspects of V4 function that are not captured by individual semantic tasks. Nevertheless, jointly considering the features of a pair of semantic classification tasks was sufficient to yield one of our top V4 models, solidifying V4’s main functional role in semantic processing and suggesting that V4’s selectivity to 2D or 3D stimulus properties found by electrophysiologists can result from semantic functional goals.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

SemanticsNeural Networks, ComputerVisual CortexModels, NeurologicalAnimalsComputational BiologyPhotic StimulationNeuronsMacaca mulattaMacaca

Autor:innen und Institutionen

  • Institute of Computer Science and Campus Institute Data Science, University of Göttingen, Göttingen, Germany.
  • Institute for Theoretical Physics and Centre for Integrative Neuroscience, University of Tübingen, Tübingen, Germany.
  • Bernstein Center for Computational Neuroscience, Tübingen, Germany.
  • International Max Planck Research School for Intelligent Systems, Tübingen, Germany.
  • Institute for Bioinformatics and Medical Informatics, University Tübingen, Tübingen, Germany.
  • Center for Neuroscience and Artificial Intelligence, Baylor College of Medicine, Houston, Texas, United States of America.

ORCID-Profile: Santiago A Cadena

Förderung

  • NIGMS NIH HHS
  • NIH HHS
  • NEI NIH HHS
  • Bundesministerium für Bildung und Forschung
  • National Science Foundation
  • Deutsche Forschungsgemeinschaft
  • Collaborative Research Center
  • Cluster of Excellence “Machine Learning – New Perspectives for Science”

Zitieren

APA

Cadena, S. A., Willeke, K. F., Restivo, K., Denfield, G., Sinz, F. H., Bethge, M., Tolias, A. S., & Ecker, A. S. (2024). Diverse task-driven modeling of macaque V4 reveals functional specialization towards semantic tasks. PLOS Computational Biology, 20(5), e1012056. https://doi.org/10.1371/journal.pcbi.1012056

Vancouver

Cadena SA, Willeke KF, Restivo K, Denfield G, Sinz FH, Bethge M, et al. Diverse task-driven modeling of macaque V4 reveals functional specialization towards semantic tasks. PLOS Computational Biology. 2024;20(5):e1012056. doi:10.1371/journal.pcbi.1012056

BibTeX
@article{Cadena2024,
  author = {Cadena, Santiago A and Willeke, Konstantin F and Restivo, Kelli and Denfield, George and Sinz, Fabian H and Bethge, Matthias and Tolias, Andreas S and Ecker, Alexander S},
  title = {Diverse task-driven modeling of macaque V4 reveals functional specialization towards semantic tasks},
  journal = {PLOS Computational Biology},
  year = {2024},
  volume = {20},
  number = {5},
  pages = {e1012056},
  doi = {10.1371/journal.pcbi.1012056}
}
Kostenlos starten →