EUVIMEDEUVIMED entdecken
Crossref

SCDM: Unified Representation Learning for EEG-to-fNIRS Cross-Modal Generation in MI-BCIs

Yisheng Li, Yishan Wang, Baiying Lei, Shuqiang Wang

IEEE Transactions on Medical Imaging · 2025-06 · 44 (6) · 2384-2394

DOI: 10.1109/tmi.2025.3532480 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Medical Imaging, 2025-06. Verfasst von Yisheng Li und 3 weiteren Autor:innen. Hauptthemen laut MEDLINE: Electroencephalography, Brain-Computer Interfaces, Signal Processing, Computer-Assisted. Die Arbeit wurde bisher 29-mal zitiert (Crossref) und nennt 63 Literaturangaben. Gefördert von: National Natural Science Foundations of China, Distinguished Young Scholars Fund of Guangdong.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Hybrid motor imagery brain-computer interfaces (MI-BCIs), which integrate both electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) signals, outperform those based solely on EEG. However, simultaneously recording EEG and fNIRS signals is highly challenging due to the difficulty of colocating both types of sensors on the same scalp surface. This physical constraint complicates the acquisition of high-quality hybrid signals, thereby limiting the widespread application of hybrid MI-BCIs. To address this issue, this study proposes the spatio-temporal controlled diffusion model (SCDM) as a framework for cross-modal generation from EEG to fNIRS. The model utilizes two core modules, the spatial cross-modal generation (SCG) module and the multi-scale temporal representation (MTR) module, which adaptively learn the respective latent temporal and spatial representations of both signals in a unified representation space. The SCG module further maps EEG representations to fNIRS representations by leveraging their spatial relationships. Experimental results show high similarity between synthetic and real fNIRS signals. The joint classification performance of EEG and synthetic fNIRS signals is comparable to or even better than that of EEG with real fNIRS signals. Furthermore, the synthetic signals exhibit similar spatio-temporal features to real signals while preserving spatial relationships with EEG signals. To our knowledge, it is the first work that an end-to-end framework is proposed to achieve cross-modal generation from EEG to fNIRS. Experimental results suggest that the SCDM may represent a promising paradigm for the acquisition of hybrid EEG-fNIRS signals in MI-BCI systems.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

ElectroencephalographyBrain-Computer InterfacesSignal Processing, Computer-AssistedHumansSpectroscopy, Near-InfraredAlgorithmsBrainAdultMale

Förderung

  • National Natural Science Foundations of China
  • Distinguished Young Scholars Fund of Guangdong

Zitieren

APA

Li, Y., Wang, Y., Lei, B., & Wang, S. (2025). SCDM: Unified Representation Learning for EEG-to-fNIRS Cross-Modal Generation in MI-BCIs. IEEE Transactions on Medical Imaging, 44(6), 2384-2394. https://doi.org/10.1109/tmi.2025.3532480

Vancouver

Li Y, Wang Y, Lei B, Wang S. SCDM: Unified Representation Learning for EEG-to-fNIRS Cross-Modal Generation in MI-BCIs. IEEE Transactions on Medical Imaging. 2025;44(6):2384-2394. doi:10.1109/tmi.2025.3532480

BibTeX
@article{Li2025,
  author = {Li, Yisheng and Wang, Yishan and Lei, Baiying and Wang, Shuqiang},
  title = {SCDM: Unified Representation Learning for EEG-to-fNIRS Cross-Modal Generation in MI-BCIs},
  journal = {IEEE Transactions on Medical Imaging},
  year = {2025},
  volume = {44},
  number = {6},
  pages = {2384--2394},
  doi = {10.1109/tmi.2025.3532480}
}
Kostenlos starten →