EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Natural scenes reveal diverse representations of 2D and 3D body pose in the human brain

Hongru Zhu iD, Yijun Ge iD, Alexander Bratch, Alan Yuille, Kendrick Kay iD, Daniel Kersten

Proceedings of the National Academy of Sciences · 2024

DOI: 10.1073/pnas.2317707121 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the National Academy of Sciences, 2024. Verfasst von Hongru Zhu und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Cognitive Science, Johns Hopkins University, Baltimore, MD 21218. Hauptthemen laut MEDLINE: Magnetic Resonance Imaging, Brain. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 69 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: HHS | NIH | National Eye Institute (NEI), National Science Foundation (NSF), NEI NIH HHS.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Human pose, defined as the spatial relationships between body parts, carries instrumental information supporting the understanding of motion and action of a person. A substantial body of previous work has identified cortical areas responsive to images of bodies and different body parts. However, the neural basis underlying the visual perception of body part relationships has received less attention. To broaden our understanding of body perception, we analyzed high-resolution fMRI responses to a wide range of poses from over 4,000 complex natural scenes. Using ground-truth annotations and an application of three-dimensional (3D) pose reconstruction algorithms, we compared similarity patterns of cortical activity with similarity patterns built from human pose models with different levels of depth availability and viewpoint dependency. Targeting the challenge of explaining variance in complex natural image responses with interpretable models, we achieved statistically significant correlations between pose models and cortical activity patterns (though performance levels are substantially lower than the noise ceiling). We found that the 3D view-independent pose model, compared with two-dimensional models, better captures the activation from distinct cortical areas, including the right posterior superior temporal sulcus (pSTS). These areas, together with other pose-selective regions in the LOTC, form a broader, distributed cortical network with greater view-tolerance in more anterior patches. We interpret these findings in light of the computational complexity of natural body images, the wide range of visual tasks supported by pose structures, and possible shared principles for view-invariant processing between articulated objects and ordinary, rigid objects.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Magnetic Resonance ImagingBrainHumansMaleFemaleAdultBrain MappingVisual PerceptionPostureYoung AdultImaging, Three-DimensionalPhotic StimulationAlgorithms

Stichwörter der Autor:innen

3D posebody perceptionnatural imagesvisual cortex

Autor:innen und Institutionen

  • Department of Cognitive Science, Johns Hopkins University, Baltimore, MD 21218.
  • Department of Psychology, University of Minnesota, Minneapolis, MN 55455.
  • Laboratory for Consciousness, Riken Center for Brain Science, Wako, Saitama 3510198, Japan.
  • Center for Magnetic Resonance Research, Department of Radiology, University of Minnesota, Minneapolis, MN 55455.

ORCID-Profile: Hongru Zhu, Yijun Ge, Kendrick Kay

Förderung

  • HHS | NIH | National Eye Institute (NEI)
  • National Science Foundation (NSF)
  • NEI NIH HHS

Zitieren

APA

Zhu, H., Ge, Y., Bratch, A., Yuille, A., Kay, K., & Kersten, D. (2024). Natural scenes reveal diverse representations of 2D and 3D body pose in the human brain. Proceedings of the National Academy of Sciences. https://doi.org/10.1073/pnas.2317707121

Vancouver

Zhu H, Ge Y, Bratch A, Yuille A, Kay K, Kersten D. Natural scenes reveal diverse representations of 2D and 3D body pose in the human brain. Proceedings of the National Academy of Sciences. 2024. doi:10.1073/pnas.2317707121

BibTeX
@article{Zhu2024,
  author = {Zhu, Hongru and Ge, Yijun and Bratch, Alexander and Yuille, Alan and Kay, Kendrick and Kersten, Daniel},
  title = {Natural scenes reveal diverse representations of 2D and 3D body pose in the human brain},
  journal = {Proceedings of the National Academy of Sciences},
  year = {2024},
  doi = {10.1073/pnas.2317707121}
}
Kostenlos starten →