EUVIMEDEUVIMED entdecken
Crossref

Spatio-temporal bidirectional Long Short-Term Memory-based category decoding of natural dynamic facial expression stimuli from visual functional magnetic resonance imaging data

Panpan Chen iD, Chi Zhang iD, Bao Li iD, Li Tong, Long Cao, Ziya Yu, Bin Yan

Cerebral Cortex · 2025

DOI: 10.1093/cercor/bhaf232 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Cerebral Cortex, 2025. Verfasst von Panpan Chen und 6 weiteren Autor:innen. Beteiligte Einrichtung: Henan Key Laboratory of Imaging and Intelligent Processing, Information Engineering University, Kexue Avenue, High-Tech Zone, Zhengzhou, Henan Zhengz…. Hauptthemen laut MEDLINE: Visual Cortex, Facial Expression, Facial Recognition, Visual Perception. Die Arbeit nennt 31 Literaturangaben. Gefördert von: STI2030-Major Projects, National Natural Science Foundation of China, Central Plains Science and Technology Innovation Leading Talent Project.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Visual perceptual decoding of facial expressions is a key focus in affective neuroscience. Developing a mapping model between visual content and signals is crucial for decoding. Most previous visual decoding models focused on brain responses to static images, neglecting temporal-dynamic feature modeling. Additionally, they input all visual cortices as a whole into the model, overlooking that visual information flows bidirectionally between the lower and higher visual cortices based on bottom-up and top-down visual mechanisms, thus hard to capture bidirectional information between visual regions located in different spatial positions. Here, we present a spatio-temporal bidirectional long short-term memory-based model to decode 3 categories of facial expressions from multi-time functional magnetic resonance imaging data. Specifically, we used the spatio-temporal bidirectional long short-term memory module with the ability to simulate time series to grasp the temporal-dependence from visual cortices, and its forward and backward directions simulate bidirectional information flow between visual cortices to capture the bidirectional spatial information. Experimental outcomes indicate that the mean decoding accuracy employing beta estimates of multi-time response signals (Repetition Times(TR)1-6 1 to 6) from 5 participants is significantly higher than that of other time points signals, unidirectional connections, and publicly available models. These results reveal that our model captures temporal-dependencies and bidirectional spatial information from the visual cortices, enhancing decoding performance.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Visual CortexFacial ExpressionFacial RecognitionVisual PerceptionHumansMagnetic Resonance ImagingFemaleMaleAdultYoung AdultBrain MappingPhotic StimulationLong Short Term Memory

Stichwörter der Autor:innen

ST-biLSTMbidirectional information flowfMRI decodingmulti-time response signalsnatural dynamic facial expressions

Autor:innen und Institutionen

  • Henan Key Laboratory of Imaging and Intelligent Processing, Information Engineering University, Kexue Avenue, High-Tech Zone, Zhengzhou, Henan Zhengzhou 450000, China.

ORCID-Profile: Panpan Chen, Chi Zhang, Bao Li

Förderung

  • STI2030-Major Projects
  • National Natural Science Foundation of China
  • Central Plains Science and Technology Innovation Leading Talent Project

Zitieren

APA

Chen, P., Zhang, C., Li, B., Tong, L., Cao, L., Yu, Z., & Yan, B. (2025). Spatio-temporal bidirectional Long Short-Term Memory-based category decoding of natural dynamic facial expression stimuli from visual functional magnetic resonance imaging data. Cerebral Cortex. https://doi.org/10.1093/cercor/bhaf232

Vancouver

Chen P, Zhang C, Li B, Tong L, Cao L, Yu Z, et al. Spatio-temporal bidirectional Long Short-Term Memory-based category decoding of natural dynamic facial expression stimuli from visual functional magnetic resonance imaging data. Cerebral Cortex. 2025. doi:10.1093/cercor/bhaf232

BibTeX
@article{Chen2025,
  author = {Chen, Panpan and Zhang, Chi and Li, Bao and Tong, Li and Cao, Long and Yu, Ziya and Yan, Bin},
  title = {Spatio-temporal bidirectional Long Short-Term Memory-based category decoding of natural dynamic facial expression stimuli from visual functional magnetic resonance imaging data},
  journal = {Cerebral Cortex},
  year = {2025},
  doi = {10.1093/cercor/bhaf232}
}
Kostenlos starten →