Emergence of Emotion Selectivity in Deep Neural Networks Trained to Recognize Visual Objects
PLOS Computational Biology · 28.03.2024 · 20 (3) · e1011943
DOI: 10.1371/journal.pcbi.1011943 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS Computational Biology, online erschienen am 28.03.2024. Verfasst von Peng Liu und 3 weiteren Autor:innen. Beteiligte Einrichtung: J. Crayton Pruitt Family Department of Biomedical Engineering, Herbert Wertheim College of Engineering, University of Florida, Gainesville, Florida, …. Hauptthemen laut MEDLINE: Neural Networks, Computer, Visual Cortex. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 116 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NIMH NIH HHS, Division of Information and Intelligent Systems, Division of Behavioral and Cognitive Sciences.
Abstract (Originalsprache)
Recent neuroimaging studies have shown that the visual cortex plays an important role in representing the affective significance of visual input. The origin of these affect-specific visual representations is debated: they are intrinsic to the visual system versus they arise through reentry from frontal emotion processing structures such as the amygdala. We examined this problem by combining convolutional neural network (CNN) models of the human ventral visual cortex pre-trained on ImageNet with two datasets of affective images. Our results show that in all layers of the CNN models, there were artificial neurons that responded consistently and selectively to neutral, pleasant, or unpleasant images and lesioning these neurons by setting their output to zero or enhancing these neurons by increasing their gain led to decreased or increased emotion recognition performance respectively. These results support the idea that the visual system may have the intrinsic ability to represent the affective significance of visual input and suggest that CNNs offer a fruitful platform for testing neuroscientific theories.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- J. Crayton Pruitt Family Department of Biomedical Engineering, Herbert Wertheim College of Engineering, University of Florida, Gainesville, Florida, United States of America.
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover, New Hampshire, United States of America.
- Center for Cognitive Aging and Memory, McKnight Brain Institute, University of Florida, Gainesville, Florida, United States of America.
ORCID-Profile: Peng Liu, Ruogu Fang
Förderung
- NIMH NIH HHS
- Division of Information and Intelligent Systems
- Division of Behavioral and Cognitive Sciences
- National Institute of Mental Health
- NVIDIA AI Technology Center, University of Florida
- Informatics Institute, University of Florida
Zitieren
APA
Liu, P., Bo, K., Ding, M., & Fang, R. (2024). Emergence of Emotion Selectivity in Deep Neural Networks Trained to Recognize Visual Objects. PLOS Computational Biology, 20(3), e1011943. https://doi.org/10.1371/journal.pcbi.1011943
Vancouver
Liu P, Bo K, Ding M, Fang R. Emergence of Emotion Selectivity in Deep Neural Networks Trained to Recognize Visual Objects. PLOS Computational Biology. 2024;20(3):e1011943. doi:10.1371/journal.pcbi.1011943
BibTeX
@article{Liu2024,
author = {Liu, Peng and Bo, Ke and Ding, Mingzhou and Fang, Ruogu},
title = {Emergence of Emotion Selectivity in Deep Neural Networks Trained to Recognize Visual Objects},
journal = {PLOS Computational Biology},
year = {2024},
volume = {20},
number = {3},
pages = {e1011943},
doi = {10.1371/journal.pcbi.1011943}
}
EUVIMED