mBGT: Encoding Brain Signals With Multimodal Brain Graph Transformer
IEEE Transactions on Consumer Electronics · 2025-05 · 71 (2) · 5812-5823
DOI: 10.1109/tce.2024.3425478 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Consumer Electronics, 2025-05. Verfasst von Ciyuan Peng und 7 weiteren Autor:innen. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 56 Literaturangaben.
Abstract (Originalsprache)
Leveraging the multimodal brain signals collected from various electronic devices, such as electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) data, has been regarded as a promising technique for automated brain disease diagnosis. Existing studies on multimodal brain signal analysis mainly focus on data alignment and basic feature integration, yet fail to capture the spatiotemporal correlations amongst diverse signals. This limitation results in the learning of biased brain signal representations. To eliminate this limitation, we propose a novel multimodal Brain Graph Transformer model, named mBGT. By learning both temporal and spatial dynamics exhibited in multiple brain signals, mBGT derives high-quality multimodal representations of brain signals from heterogeneous data sources. Specifically, we construct a dynamic brain graph based on simultaneous EEG-fNIRS data, which effectively embeds the spatiotemporal correlations amongst brain signals. Thereafter, we propose a spatiotemporal information enhanced graph Transformer to encode the constructed brain graph, extensively exploring the functional interactions among different brain regions. Extensive experiments are conducted on a public dataset to demonstrate the advantages of mBGT in terms of the performance in downstream detection tasks, compared to multiple state-of-the-art baselines. These highlight the superiority of mBGT in learning effective representations for brain graphs from multimodal brain signals.
Zitieren
APA
Peng, C., Guo, T., Xie, C., Bai, X., Zhou, J., Zhao, X., He, E., & Xia, F. (2025). mBGT: Encoding Brain Signals With Multimodal Brain Graph Transformer. IEEE Transactions on Consumer Electronics, 71(2), 5812-5823. https://doi.org/10.1109/tce.2024.3425478
Vancouver
Peng C, Guo T, Xie C, Bai X, Zhou J, Zhao X, et al. mBGT: Encoding Brain Signals With Multimodal Brain Graph Transformer. IEEE Transactions on Consumer Electronics. 2025;71(2):5812-5823. doi:10.1109/tce.2024.3425478
BibTeX
@article{Peng2025,
author = {Peng, Ciyuan and Guo, Tianqi and Xie, Chengyao and Bai, Xiaomei and Zhou, Jingjing and Zhao, Xiaohui and He, Estrid and Xia, Feng},
title = {mBGT: Encoding Brain Signals With Multimodal Brain Graph Transformer},
journal = {IEEE Transactions on Consumer Electronics},
year = {2025},
volume = {71},
number = {2},
pages = {5812--5823},
doi = {10.1109/tce.2024.3425478}
}
EUVIMED