EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

The perceptual primacy of feeling: Affectless visual machines explain a majority of variance in human visually evoked affect

Colin Conwell iD, Daniel Graham iD, Chelsea Boccagno, Edward A Vessel iD

Proceedings of the National Academy of Sciences · 28.01.2025 · 122 (4)

DOI: 10.1073/pnas.2306025121 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the National Academy of Sciences, online erschienen am 23.01.2025. Verfasst von Colin Conwell und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychology, Harvard University, Cambridge, MA 02139. Hauptthemen laut MEDLINE: Visual Perception, Emotions, Affect. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 127 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NIMH NIH HHS.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Looking at the world often involves not just seeing things, but feeling things. Modern feedforward machine vision systems that learn to perceive the world in the absence of active physiology, deliberative thought, or any form of feedback that resembles human affective experience offer tools to demystify the relationship between seeing and feeling, and to assess how much of visually evoked affective experiences may be a straightforward function of representation learning over natural image statistics. In this work, we deploy a diverse sample of 180 state-of-the-art deep neural network models trained only on canonical computer vision tasks to predict human ratings of arousal, valence, and beauty for images from multiple categories (objects, faces, landscapes, art) across two datasets. Importantly, we use the features of these models without additional learning, linearly decoding human affective responses from network activity in much the same way neuroscientists decode information from neural recordings. Aggregate analysis across our survey, demonstrates that predictions from purely perceptual models explain a majority of the explainable variance in average ratings of arousal, valence, and beauty alike. Finer-grained analysis within our survey (e.g. comparisons between shallower and deeper layers, or between randomly initialized, category-supervised, and self-supervised models) point to rich, preconceptual abstraction (learned from diversity of visual experience) as a key driver of these predictions. Taken together, these results provide further computational evidence for an information-processing account of visually evoked affect linked directly to efficient representation learning over natural image statistics, and hint at a computational locus of affective and aesthetic valuation immediately proximate to perception.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Visual PerceptionEmotionsAffectHumansNeural Networks, ComputerMaleFemaleArousalAdultDeep Learning

Stichwörter der Autor:innen

aestheticsaffective sciencecognitive neurosciencemachine visionvisually evoked affect

Autor:innen und Institutionen

  • Department of Psychology, Harvard University, Cambridge, MA 02139.
  • Department of Psychological Science, Hobart and William Smith Colleges.
  • Department of Psychiatry, Massachusetts General Hospital, Boston, MA 02114.
  • Department of Epidemiology, Harvard T.H. Chan School of Public Health.
  • Department of Psychology, City College, City University of New York, New York, NY 10031.

ORCID-Profile: Colin Conwell, Daniel Graham, Edward A Vessel

Förderung

  • NIMH NIH HHS

Zitieren

APA

Conwell, C., Graham, D., Boccagno, C., & Vessel, E. A. (2025). The perceptual primacy of feeling: Affectless visual machines explain a majority of variance in human visually evoked affect. Proceedings of the National Academy of Sciences, 122(4). https://doi.org/10.1073/pnas.2306025121

Vancouver

Conwell C, Graham D, Boccagno C, Vessel EA. The perceptual primacy of feeling: Affectless visual machines explain a majority of variance in human visually evoked affect. Proceedings of the National Academy of Sciences. 2025;122(4). doi:10.1073/pnas.2306025121

BibTeX
@article{Conwell2025,
  author = {Conwell, Colin and Graham, Daniel and Boccagno, Chelsea and Vessel, Edward A},
  title = {The perceptual primacy of feeling: Affectless visual machines explain a majority of variance in human visually evoked affect},
  journal = {Proceedings of the National Academy of Sciences},
  year = {2025},
  volume = {122},
  number = {4},
  doi = {10.1073/pnas.2306025121}
}
Kostenlos starten →