EUVIMEDEUVIMED entdecken
Crossref

Relational Information Predicts Human Behavior and Neural Responses to Complex Social Scenes

Cognitive Science Society 2025, Leyla Işık, Manasi Malik, Wenshuo Qin

eScholarship (California Digital Library) · 18.06.2025

DOI: 10.48448/yfbd-vz79 ↗

Kurz gefasst

Fachartikel in der Zeitschrift eScholarship (California Digital Library), erschienen am 18.06.2025. Verfasst von Cognitive Science Society 2025 und 3 weiteren Autor:innen.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Understanding social scenes depends on tracking relational visual information, which is prioritized behaviorally and represented in the superior temporal sulcus (STS), a region involved in processing social scenes. Despite its importance, relational information has been underutilized in computational models of social vision. In this study, we evaluate two neural network models—SocialGNN and RNN Edge—that explicitly incorporate relational cues, and compare their performance to state-of-the-art (SOTA) AI vision models. SocialGNN utilizes a graph neural network to organize input information about each video frame into a graph structure with nodes representing faces and key objects, and edges encoding relational information such as gaze direction and physical contact. RNN Edge is an even simpler model that processes only relational information without node features or graph-based structures. These models were tested on behavioral and neural data from 3-second natural videos of two people engaged in everyday activities, as well as on the PHASE dataset, a collection of 2D animations depicting agent-object interactions inspired by Heider and Simmel. Across both datasets, SocialGNN and RNN Edge achieved strong performance in predicting human behavioral ratings of social interactions and were comparable to SOTA AI models in behavioral encoding tasks, despite being trained on significantly less data and with simpler architectures. Notably, the success of RNN Edge suggests that additional visual features and the graph-based framework of SocialGNN do not significantly enhance performance, underscoring the primacy of gaze and physical contact as essential relational cues. These findings emphasize the importance of integrating relational information into computational models to develop better models of social perception and human-aligned AI.

Schlagwörter

relational informationsocial visionsuperior temporal sulcusgraph neural networksgaze directionphysical contact

Zitieren

APA

2025, C. S. S., Işık, L., Malik, M., & Qin, W. (2025). Relational Information Predicts Human Behavior and Neural Responses to Complex Social Scenes. eScholarship (California Digital Library). https://doi.org/10.48448/yfbd-vz79

Vancouver

2025 CSS, Işık L, Malik M, Qin W. Relational Information Predicts Human Behavior and Neural Responses to Complex Social Scenes. eScholarship (California Digital Library). 2025. doi:10.48448/yfbd-vz79

BibTeX
@article{2025,
  author = {2025, Cognitive Science Society and Işık, Leyla and Malik, Manasi and Qin, Wenshuo},
  title = {Relational Information Predicts Human Behavior and Neural Responses to Complex Social Scenes},
  journal = {eScholarship (California Digital Library)},
  year = {2025},
  doi = {10.48448/yfbd-vz79}
}
Kostenlos starten →