Natural scenes reveal diverse representations of 2D and 3D body pose in the human brain
Proceedings of the National Academy of Sciences · 2024
DOI: 10.1073/pnas.2317707121 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the National Academy of Sciences, 2024. Verfasst von Hongru Zhu und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Cognitive Science, Johns Hopkins University, Baltimore, MD 21218. Hauptthemen laut MEDLINE: Magnetic Resonance Imaging, Brain. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 69 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: HHS | NIH | National Eye Institute (NEI), National Science Foundation (NSF), NEI NIH HHS.
Abstract (Originalsprache)
Human pose, defined as the spatial relationships between body parts, carries instrumental information supporting the understanding of motion and action of a person. A substantial body of previous work has identified cortical areas responsive to images of bodies and different body parts. However, the neural basis underlying the visual perception of body part relationships has received less attention. To broaden our understanding of body perception, we analyzed high-resolution fMRI responses to a wide range of poses from over 4,000 complex natural scenes. Using ground-truth annotations and an application of three-dimensional (3D) pose reconstruction algorithms, we compared similarity patterns of cortical activity with similarity patterns built from human pose models with different levels of depth availability and viewpoint dependency. Targeting the challenge of explaining variance in complex natural image responses with interpretable models, we achieved statistically significant correlations between pose models and cortical activity patterns (though performance levels are substantially lower than the noise ceiling). We found that the 3D view-independent pose model, compared with two-dimensional models, better captures the activation from distinct cortical areas, including the right posterior superior temporal sulcus (pSTS). These areas, together with other pose-selective regions in the LOTC, form a broader, distributed cortical network with greater view-tolerance in more anterior patches. We interpret these findings in light of the computational complexity of natural body images, the wide range of visual tasks supported by pose structures, and possible shared principles for view-invariant processing between articulated objects and ordinary, rigid objects.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Cognitive Science, Johns Hopkins University, Baltimore, MD 21218.
- Department of Psychology, University of Minnesota, Minneapolis, MN 55455.
- Laboratory for Consciousness, Riken Center for Brain Science, Wako, Saitama 3510198, Japan.
- Center for Magnetic Resonance Research, Department of Radiology, University of Minnesota, Minneapolis, MN 55455.
ORCID-Profile: Hongru Zhu, Yijun Ge, Kendrick Kay
Förderung
- HHS | NIH | National Eye Institute (NEI)
- National Science Foundation (NSF)
- NEI NIH HHS
Zitieren
APA
Zhu, H., Ge, Y., Bratch, A., Yuille, A., Kay, K., & Kersten, D. (2024). Natural scenes reveal diverse representations of 2D and 3D body pose in the human brain. Proceedings of the National Academy of Sciences. https://doi.org/10.1073/pnas.2317707121
Vancouver
Zhu H, Ge Y, Bratch A, Yuille A, Kay K, Kersten D. Natural scenes reveal diverse representations of 2D and 3D body pose in the human brain. Proceedings of the National Academy of Sciences. 2024. doi:10.1073/pnas.2317707121
BibTeX
@article{Zhu2024,
author = {Zhu, Hongru and Ge, Yijun and Bratch, Alexander and Yuille, Alan and Kay, Kendrick and Kersten, Daniel},
title = {Natural scenes reveal diverse representations of 2D and 3D body pose in the human brain},
journal = {Proceedings of the National Academy of Sciences},
year = {2024},
doi = {10.1073/pnas.2317707121}
}
EUVIMED