NeuroFusion-Trans: A Novel Transformer-Based EEG-EMG Fusion Model for Assistive Robotics
IEEE Access · 2025 · 13 · 103245-103263
DOI: 10.1109/access.2025.3577996 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Access, 2025. Verfasst von Tipu Sultan und 5 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 28 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Princess Nourah bint Abdulrahman University, Riyadh, Saudi Arabia.
Abstract (Originalsprache)
User intent recognition from multimodal neurophysiological signals, particularly electroencephalography (EEG) and electromyography (EMG), is critical for enhancing human-machine interaction in assistive robotics. Recent advances in neurophysiological signal processing have enabled enhanced user intent recognition for assistive robotics and human-machine interfaces. However, achieving high accuracy and real-time adaptability in electromyography (EMG) and electroencephalography (EEG)-based gesture recognition remains challenging due to temporal misalignment, weak cross-modality fusion, and lack of adaptive learning. This paper proposes NeuroFusion-Trans, a novel transformer-based framework that improves EEG-EMG gesture recognition by improving temporal resolution, using cross-modality attention, and integrating adaptive online learning. Temporal resolution enhancement ensures dynamic EEG-EMG synchronization for improved signal alignment. The cross-modality attention mechanism captures interdependencies between EEG and EMG signals, leading to more accurate intent classification. Adaptive online learning enables real-time personalization by dynamically adjusting to user-specific variations. The model is evaluated on two publicly available EEG-EMG upper-limb gesture datasets: Dataset 1 (5,296 for training, 1,324 for validation) and Dataset 2 (5,276 for training, 1,304 for validation). NeuroFusion-Trans achieves state-of-the-art performance, with an accuracy of 97% and 96% and Cohen’s Kappa of 0.97 and 0.95 after online adaptation, significantly outperforming baseline models such as CNN-LSTM, GRU, and LSTMNet. Ablation studies reveal that removing the cross-modality attention mechanism reduces accuracy by 6.1%, underscoring its importance in leveraging EEG-EMG dependencies. Turning off synchronization leads to a 6.7% performance drop, demonstrating the necessity of real-time learning for robust intent recognition. Furthermore, NeuroFusion-Trans enhances EEG-EMG synchronization, achieving synchronization scores of 0.7471 on Dataset 1 and 0.7687 on Dataset 2, confirming its effectiveness in temporal alignment. The proposed approach demonstrates robust generalization, improved responsiveness, and potential applications in real-time assistive robotics.
Förderung
- Princess Nourah bint Abdulrahman University, Riyadh, Saudi Arabia
Zitieren
APA
Sultan, T., Liu, G., Sikorski, P., Alshathri, S., El-Shafai, W., & Babaiasl, M. (2025). NeuroFusion-Trans: A Novel Transformer-Based EEG-EMG Fusion Model for Assistive Robotics. IEEE Access, 13, 103245-103263. https://doi.org/10.1109/access.2025.3577996
Vancouver
Sultan T, Liu G, Sikorski P, Alshathri S, El-Shafai W, Babaiasl M. NeuroFusion-Trans: A Novel Transformer-Based EEG-EMG Fusion Model for Assistive Robotics. IEEE Access. 2025;13:103245-103263. doi:10.1109/access.2025.3577996
BibTeX
@article{Sultan2025,
author = {Sultan, Tipu and Liu, Guangping and Sikorski, Pascal and Alshathri, Samah and El-Shafai, Walid and Babaiasl, Madi},
title = {NeuroFusion-Trans: A Novel Transformer-Based EEG-EMG Fusion Model for Assistive Robotics},
journal = {IEEE Access},
year = {2025},
volume = {13},
pages = {103245--103263},
doi = {10.1109/access.2025.3577996}
}
EUVIMED