EUVIMEDEUVIMED entdecken
Open Access

Comparing the Dominance of Color and Form Information across the Human Ventral Visual Pathway and Convolutional Neural Networks

JohnMark Taylor iD, Yaoda Xu

Journal of Cognitive Neuroscience · 2023

DOI: 10.1162/jocn_a_01979 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Cognitive Neuroscience, 2023. Verfasst von JohnMark Taylor und 1 weiteren Autor:innen. Beteiligte Einrichtung: Columbia University, New York, NY. Hauptthemen laut MEDLINE: Visual Pathways, Visual Cortex. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 70 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: NEI NIH HHS, NIH HHS, National Science Foundation.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Color and form information can be decoded in every region of the human ventral visual hierarchy, and at every layer of many convolutional neural networks (CNNs) trained to recognize objects, but how does the coding strength of these features vary over processing? Here, we characterize for these features both their absolute coding strength—how strongly each feature is represented independent of the other feature—and their relative coding strength—how strongly each feature is encoded relative to the other, which could constrain how well a feature can be read out by downstream regions across variation in the other feature. To quantify relative coding strength, we define a measure called the form dominance index that compares the relative influence of color and form on the representational geometry at each processing stage. We analyze brain and CNN responses to stimuli varying based on color and either a simple form feature, orientation, or a more complex form feature, curvature. We find that while the brain and CNNs largely differ in how the absolute coding strength of color and form vary over processing, comparing them in terms of their relative emphasis of these features reveals a striking similarity: For both the brain and for CNNs trained for object recognition (but not for untrained CNNs), orientation information is increasingly de-emphasized, and curvature information is increasingly emphasized, relative to color information over processing, with corresponding processing stages showing largely similar values of the form dominance index.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Visual PathwaysVisual CortexHumansVisual PerceptionNeural Networks, ComputerBrain

Autor:innen und Institutionen

  • Columbia University, New York, NY.
  • Yale University, New Haven, CT.

ORCID-Profile: JohnMark Taylor

Förderung

  • NEI NIH HHS
  • NIH HHS
  • National Science Foundation
  • National Institute of Health

Zitieren

APA

Taylor, J., & Xu, Y. (2023). Comparing the Dominance of Color and Form Information across the Human Ventral Visual Pathway and Convolutional Neural Networks. Journal of Cognitive Neuroscience. https://doi.org/10.1162/jocn_a_01979

Vancouver

Taylor J, Xu Y. Comparing the Dominance of Color and Form Information across the Human Ventral Visual Pathway and Convolutional Neural Networks. Journal of Cognitive Neuroscience. 2023. doi:10.1162/jocn_a_01979

BibTeX
@article{Taylor2023,
  author = {Taylor, JohnMark and Xu, Yaoda},
  title = {Comparing the Dominance of Color and Form Information across the Human Ventral Visual Pathway and Convolutional Neural Networks},
  journal = {Journal of Cognitive Neuroscience},
  year = {2023},
  doi = {10.1162/jocn_a_01979}
}
Kostenlos starten →