EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Dataglove for Sign Language Recognition of People with Hearing and Speech Impairment via Wearable Inertial Sensors

Ang Ji, Yongzhen Wang, Xin Miao, Tianqi Fan, Bo Ru, Long Liu iD, Ruicheng Nie, Sen Qiu iD

Sensors · 2023

DOI: 10.3390/s23156693 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, 2023. Verfasst von Ang Ji und 7 weiteren Autor:innen. Beteiligte Einrichtung: Asset Management Department, Ketai Lexun (Beijing) Communication Equipment Co., Ltd., Beijing 101111, China. Hauptthemen laut MEDLINE: Sign Language, Wearable Electronic Devices. Die Arbeit wurde bisher 35-mal zitiert (Crossref) und nennt 28 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Natural Science Foundation of Liaoning Province, China, Fundamental Studies Funds for the Central Universities, China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Finding ways to enable seamless communication between deaf and able-bodied individuals has been a challenging and pressing issue. This paper proposes a solution to this problem by designing a low-cost data glove that utilizes multiple inertial sensors with the purpose of achieving efficient and accurate sign language recognition. In this study, four machine learning models—decision tree (DT), support vector machine (SVM), K-nearest neighbor method (KNN), and random forest (RF)—were employed to recognize 20 different types of dynamic sign language data used by deaf individuals. Additionally, a proposed attention-based mechanism of long and short-term memory neural networks (Attention-BiLSTM) was utilized in the process. Furthermore, this study verifies the impact of the number and position of data glove nodes on the accuracy of recognizing complex dynamic sign language. Finally, the proposed method is compared with existing state-of-the-art algorithms using nine public datasets. The results indicate that both the Attention-BiLSTM and RF algorithms have the highest performance in recognizing the twenty dynamic sign language gestures, with an accuracy of 98.85% and 97.58%, respectively. This provides evidence for the feasibility of our proposed data glove and recognition methods. This study may serve as a valuable reference for the development of wearable sign language recognition devices and promote easier communication between deaf and able-bodied individuals.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Sign LanguageWearable Electronic DevicesHumansSpeechAlgorithmsHearing

Stichwörter der Autor:innen

deep learningmachine learningmulti-sensor information fusionsign language recognitionwearable device

Autor:innen und Institutionen

  • Asset Management Department, Ketai Lexun (Beijing) Communication Equipment Co., Ltd., Beijing 101111, China.
  • Scientific and Technological Innovation Center, Beijing 100012, China.
  • Key Laboratory of Intelligent Control and Optimization for Industrial Equipment of Ministry of Education, Dalian University of Technology, Dalian 116024, China.

ORCID-Profile: Long Liu, Sen Qiu

Förderung

  • National Natural Science Foundation of China
  • Natural Science Foundation of Liaoning Province, China
  • Fundamental Studies Funds for the Central Universities, China

Zitieren

APA

Ji, A., Wang, Y., Miao, X., Fan, T., Ru, B., Liu, L., Nie, R., & Qiu, S. (2023). Dataglove for Sign Language Recognition of People with Hearing and Speech Impairment via Wearable Inertial Sensors. Sensors. https://doi.org/10.3390/s23156693

Vancouver

Ji A, Wang Y, Miao X, Fan T, Ru B, Liu L, et al. Dataglove for Sign Language Recognition of People with Hearing and Speech Impairment via Wearable Inertial Sensors. Sensors. 2023. doi:10.3390/s23156693

BibTeX
@article{Ji2023,
  author = {Ji, Ang and Wang, Yongzhen and Miao, Xin and Fan, Tianqi and Ru, Bo and Liu, Long and Nie, Ruicheng and Qiu, Sen},
  title = {Dataglove for Sign Language Recognition of People with Hearing and Speech Impairment via Wearable Inertial Sensors},
  journal = {Sensors},
  year = {2023},
  doi = {10.3390/s23156693}
}
Kostenlos starten →