Sentence-Level Silent Speech Recognition Using a Wearable EMG/EEG Sensor System with AI-Driven Sensor Fusion and Language Model
Sensors · 05.10.2025 · 25 (19) · 6168
DOI: 10.3390/s25196168 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 05.10.2025. Verfasst von Nicholas Satterlee und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Mechanical Engineering, San Diego State University, San Diego, CA 92182, USA. Hauptthemen laut MEDLINE: Electromyography, Electroencephalography, Wearable Electronic Devices, Speech Recognition Software. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 28 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Electronics and Telecommunications Research Institute, Collective Behavioral Modelling in Socially Interacting Group.
Abstract (Originalsprache)
Silent speech recognition (SSR) enables communication without vocalization by interpreting biosignals such as electromyography (EMG) and electroencephalography (EEG). Most existing SSR systems rely on high-density, non-wearable sensors and focus primarily on isolated word recognition, limiting their practical usability. This study presents a wearable SSR system capable of accurate sentence-level recognition using single-channel EMG and EEG sensors with real-time wireless transmission. A moving window-based few-shot learning model, implemented with a Siamese neural network, segments and classifies words from continuous biosignals without requiring pauses or manual segmentation between word signals. A novel sensor fusion model integrates both EMG and EEG modalities, enhancing classification accuracy. To further improve sentence-level recognition, a statistical language model (LM) is applied as post-processing to correct syntactic and lexical errors. The system was evaluated on a dataset of four military command sentences containing ten unique words, achieving 95.25% sentence-level recognition accuracy. These results demonstrate the feasibility of sentence-level SSR using wearable sensors through a window-based few-shot learning model, sensor fusion, and ML applied to limited simultaneous EMG and EEG signals.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Mechanical Engineering, San Diego State University, San Diego, CA 92182, USA.
ORCID-Profile: Xiaowei Zuo, Kee Moon, Sung Q Lee, John S Kang
Förderung
- Electronics and Telecommunications Research Institute
- Collective Behavioral Modelling in Socially Interacting Group
Zitieren
APA
Satterlee, N., Zuo, X., Moon, K., Lee, S. Q., Peterson, M., & Kang, J. S. (2025). Sentence-Level Silent Speech Recognition Using a Wearable EMG/EEG Sensor System with AI-Driven Sensor Fusion and Language Model. Sensors, 25(19), 6168. https://doi.org/10.3390/s25196168
Vancouver
Satterlee N, Zuo X, Moon K, Lee SQ, Peterson M, Kang JS. Sentence-Level Silent Speech Recognition Using a Wearable EMG/EEG Sensor System with AI-Driven Sensor Fusion and Language Model. Sensors. 2025;25(19):6168. doi:10.3390/s25196168
BibTeX
@article{Satterlee2025,
author = {Satterlee, Nicholas and Zuo, Xiaowei and Moon, Kee and Lee, Sung Q and Peterson, Matthew and Kang, John S},
title = {Sentence-Level Silent Speech Recognition Using a Wearable EMG/EEG Sensor System with AI-Driven Sensor Fusion and Language Model},
journal = {Sensors},
year = {2025},
volume = {25},
number = {19},
pages = {6168},
doi = {10.3390/s25196168}
}
EUVIMED