EUVIMEDEUVIMED entdecken
Crossref

Task sub-type states decoding via group deep bidirectional recurrent neural network

Shijie Zhao, Long Fang, Yang Yang, Guochang Tang, Guoxin Luo, Junwei Han, Tianming Liu, Xintao Hu

Medical Image Analysis · 2024-05 · 94 · 103136

DOI: 10.1016/j.media.2024.103136 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Medical Image Analysis, 2024-05. Verfasst von Shijie Zhao und 7 weiteren Autor:innen. Beteiligte Einrichtung: School of Automation, Northwestern Polytechnical University, Xi'an 710072, China; Research & Development Institute of Northwestern Polytechnical Univ…. Hauptthemen laut MEDLINE: Brain, Connectome. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 65 Literaturangaben. Gefördert von: National Natural Science Foundation of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Decoding brain states under different cognitive tasks from functional magnetic resonance imaging (fMRI) data has attracted great attention in the neuroimaging filed. However, the well-known temporal dependency in fMRI sequences has not been fully exploited in existing studies, due to the limited temporal-modeling capacity of the backbone machine learning algorithms and rigid training sample organization strategies upon which the brain decoding methods are built. To address these limitations, we propose a novel method for fine-grain brain state decoding, namely, group deep bidirectional recurrent neural network (Group-DBRNN) model. We first propose a training sample organization strategy that consists of a group-task sample generation module and a multiple-scale random fragment strategy (MRFS) module to collect training samples that contain rich task-relevant brain activity contrast (i.e., the comparison of neural activity patterns between different tasks) and maintain the temporal dependency. We then develop a novel decoding model by replacing the unidirectional RNNs that are widely used in existing brain state decoding studies with bidirectional stacked RNNs to better capture the temporal dependency, and by introducing a multi-task interaction layer (MTIL) module to effectively model the task-relevant brain activity contrast. Our experimental results on the Human Connectome Project task fMRI dataset (7 tasks consisting of 23 task sub-type states) show that the proposed model achieves an average decoding accuracy of 94.7% over the 23 fine-grain sub-type states. Meanwhile, our extensive interpretations of the intermediate features learned in the proposed model via visualizations and quantitative assessments of their discriminability and inter-subject alignment evidence that the proposed model can effectively capture the temporal dependency and task-relevant contrast.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

BrainConnectomeHumansNeural Networks, ComputerAlgorithmsMagnetic Resonance Imaging

Stichwörter der Autor:innen

Bidirectional stacked RNNsBrain stage decodingFunctional magnetic resonance imagingTask-relevant brain activity contrastTemporal dependency

Autor:innen und Institutionen

  • School of Automation, Northwestern Polytechnical University, Xi'an 710072, China; Research & Development Institute of Northwestern Polytechnical University in Shenzhen, China.
  • School of Automation, Northwestern Polytechnical University, Xi'an 710072, China.
  • Department of Ophthalmology, Nanyang First People's Hospital Affiliated to Henan University, Nanyang 473000, China.
  • School of Computing, The University of Georgia, GA, USA.
  • School of Automation, Northwestern Polytechnical University, Xi'an 710072, China. Electronic address: xhu@nwpu.edu.cn.

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Zhao, S., Fang, L., Yang, Y., Tang, G., Luo, G., Han, J., Liu, T., & Hu, X. (2024). Task sub-type states decoding via group deep bidirectional recurrent neural network. Medical Image Analysis, 94, 103136. https://doi.org/10.1016/j.media.2024.103136

Vancouver

Zhao S, Fang L, Yang Y, Tang G, Luo G, Han J, et al. Task sub-type states decoding via group deep bidirectional recurrent neural network. Medical Image Analysis. 2024;94:103136. doi:10.1016/j.media.2024.103136

BibTeX
@article{Zhao2024,
  author = {Zhao, Shijie and Fang, Long and Yang, Yang and Tang, Guochang and Luo, Guoxin and Han, Junwei and Liu, Tianming and Hu, Xintao},
  title = {Task sub-type states decoding via group deep bidirectional recurrent neural network},
  journal = {Medical Image Analysis},
  year = {2024},
  volume = {94},
  pages = {103136},
  doi = {10.1016/j.media.2024.103136}
}
Kostenlos starten →