EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Emergence of Emotion Selectivity in Deep Neural Networks Trained to Recognize Visual Objects

Peng Liu iD, Ke Bo, Mingzhou Ding, Ruogu Fang iD

PLOS Computational Biology · 28.03.2024 · 20 (3) · e1011943

DOI: 10.1371/journal.pcbi.1011943 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS Computational Biology, online erschienen am 28.03.2024. Verfasst von Peng Liu und 3 weiteren Autor:innen. Beteiligte Einrichtung: J. Crayton Pruitt Family Department of Biomedical Engineering, Herbert Wertheim College of Engineering, University of Florida, Gainesville, Florida, …. Hauptthemen laut MEDLINE: Neural Networks, Computer, Visual Cortex. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 116 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NIMH NIH HHS, Division of Information and Intelligent Systems, Division of Behavioral and Cognitive Sciences.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Recent neuroimaging studies have shown that the visual cortex plays an important role in representing the affective significance of visual input. The origin of these affect-specific visual representations is debated: they are intrinsic to the visual system versus they arise through reentry from frontal emotion processing structures such as the amygdala. We examined this problem by combining convolutional neural network (CNN) models of the human ventral visual cortex pre-trained on ImageNet with two datasets of affective images. Our results show that in all layers of the CNN models, there were artificial neurons that responded consistently and selectively to neutral, pleasant, or unpleasant images and lesioning these neurons by setting their output to zero or enhancing these neurons by increasing their gain led to decreased or increased emotion recognition performance respectively. These results support the idea that the visual system may have the intrinsic ability to represent the affective significance of visual input and suggest that CNNs offer a fruitful platform for testing neuroscientific theories.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Neural Networks, ComputerVisual CortexHumansNeuroimagingNeuronsRecognition, Psychology

Autor:innen und Institutionen

  • J. Crayton Pruitt Family Department of Biomedical Engineering, Herbert Wertheim College of Engineering, University of Florida, Gainesville, Florida, United States of America.
  • Department of Psychological and Brain Sciences, Dartmouth College, Hanover, New Hampshire, United States of America.
  • Center for Cognitive Aging and Memory, McKnight Brain Institute, University of Florida, Gainesville, Florida, United States of America.

ORCID-Profile: Peng Liu, Ruogu Fang

Förderung

  • NIMH NIH HHS
  • Division of Information and Intelligent Systems
  • Division of Behavioral and Cognitive Sciences
  • National Institute of Mental Health
  • NVIDIA AI Technology Center, University of Florida
  • Informatics Institute, University of Florida

Zitieren

APA

Liu, P., Bo, K., Ding, M., & Fang, R. (2024). Emergence of Emotion Selectivity in Deep Neural Networks Trained to Recognize Visual Objects. PLOS Computational Biology, 20(3), e1011943. https://doi.org/10.1371/journal.pcbi.1011943

Vancouver

Liu P, Bo K, Ding M, Fang R. Emergence of Emotion Selectivity in Deep Neural Networks Trained to Recognize Visual Objects. PLOS Computational Biology. 2024;20(3):e1011943. doi:10.1371/journal.pcbi.1011943

BibTeX
@article{Liu2024,
  author = {Liu, Peng and Bo, Ke and Ding, Mingzhou and Fang, Ruogu},
  title = {Emergence of Emotion Selectivity in Deep Neural Networks Trained to Recognize Visual Objects},
  journal = {PLOS Computational Biology},
  year = {2024},
  volume = {20},
  number = {3},
  pages = {e1011943},
  doi = {10.1371/journal.pcbi.1011943}
}
Kostenlos starten →