EUVIMEDEUVIMED entdecken
Crossref

mBGT: Encoding Brain Signals With Multimodal Brain Graph Transformer

Ciyuan Peng, Tianqi Guo, Chengyao Xie, Xiaomei Bai, Jingjing Zhou, Xiaohui Zhao, Estrid He, Feng Xia

IEEE Transactions on Consumer Electronics · 2025-05 · 71 (2) · 5812-5823

DOI: 10.1109/tce.2024.3425478 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Consumer Electronics, 2025-05. Verfasst von Ciyuan Peng und 7 weiteren Autor:innen. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 56 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Leveraging the multimodal brain signals collected from various electronic devices, such as electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) data, has been regarded as a promising technique for automated brain disease diagnosis. Existing studies on multimodal brain signal analysis mainly focus on data alignment and basic feature integration, yet fail to capture the spatiotemporal correlations amongst diverse signals. This limitation results in the learning of biased brain signal representations. To eliminate this limitation, we propose a novel multimodal Brain Graph Transformer model, named mBGT. By learning both temporal and spatial dynamics exhibited in multiple brain signals, mBGT derives high-quality multimodal representations of brain signals from heterogeneous data sources. Specifically, we construct a dynamic brain graph based on simultaneous EEG-fNIRS data, which effectively embeds the spatiotemporal correlations amongst brain signals. Thereafter, we propose a spatiotemporal information enhanced graph Transformer to encode the constructed brain graph, extensively exploring the functional interactions among different brain regions. Extensive experiments are conducted on a public dataset to demonstrate the advantages of mBGT in terms of the performance in downstream detection tasks, compared to multiple state-of-the-art baselines. These highlight the superiority of mBGT in learning effective representations for brain graphs from multimodal brain signals.

Zitieren

APA

Peng, C., Guo, T., Xie, C., Bai, X., Zhou, J., Zhao, X., He, E., & Xia, F. (2025). mBGT: Encoding Brain Signals With Multimodal Brain Graph Transformer. IEEE Transactions on Consumer Electronics, 71(2), 5812-5823. https://doi.org/10.1109/tce.2024.3425478

Vancouver

Peng C, Guo T, Xie C, Bai X, Zhou J, Zhao X, et al. mBGT: Encoding Brain Signals With Multimodal Brain Graph Transformer. IEEE Transactions on Consumer Electronics. 2025;71(2):5812-5823. doi:10.1109/tce.2024.3425478

BibTeX
@article{Peng2025,
  author = {Peng, Ciyuan and Guo, Tianqi and Xie, Chengyao and Bai, Xiaomei and Zhou, Jingjing and Zhao, Xiaohui and He, Estrid and Xia, Feng},
  title = {mBGT: Encoding Brain Signals With Multimodal Brain Graph Transformer},
  journal = {IEEE Transactions on Consumer Electronics},
  year = {2025},
  volume = {71},
  number = {2},
  pages = {5812--5823},
  doi = {10.1109/tce.2024.3425478}
}
Kostenlos starten →