EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

SVIT‐SSR: A sEMG‐based vision transformer approach for silent speech recognition

Zhao Li, Bin Ma, Weifan Mao, Jianxing Zhang, Zhuting Yu, Yizhou Lu

Electronics Letters · 2024-11 · 60 (21)

DOI: 10.1049/ell2.13285 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Electronics Letters, online erschienen am 23.10.2024. Verfasst von Zhao Li und 5 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 10 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Silent speech recognition (SSR) based on surface electromyography (sEMG) is a voice interaction technology proposed for scenarios requiring silent operations. This article abstracts the SSR task based on sEMG into a short‐term image sequence classification task. Time‐frequency domain feature extraction and data reconstruction on the muscle activity segment data is performed. Additionally, the temporal and spatial dimensions to capture the intrinsic correlation representation of muscle activity is analysed. The SVIT‐SSR model is proposed based on the vision transformer (VIT) framework. Finally, experiments to identify 33 types of typical silent speech commands in the SSR dataset are designed. The results demonstrate that the proposed model achieves an accuracy of 96.67 ± 1.15%, outperforming similar algorithms.

Zitieren

APA

Li, Z., Ma, B., Mao, W., Zhang, J., Yu, Z., & Lu, Y. (2024). SVIT‐SSR: A sEMG‐based vision transformer approach for silent speech recognition. Electronics Letters, 60(21). https://doi.org/10.1049/ell2.13285

Vancouver

Li Z, Ma B, Mao W, Zhang J, Yu Z, Lu Y. SVIT‐SSR: A sEMG‐based vision transformer approach for silent speech recognition. Electronics Letters. 2024;60(21). doi:10.1049/ell2.13285

BibTeX
@article{Li2024,
  author = {Li, Zhao and Ma, Bin and Mao, Weifan and Zhang, Jianxing and Yu, Zhuting and Lu, Yizhou},
  title = {SVIT‐SSR: A sEMG‐based vision transformer approach for silent speech recognition},
  journal = {Electronics Letters},
  year = {2024},
  volume = {60},
  number = {21},
  doi = {10.1049/ell2.13285}
}
Kostenlos starten →