EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Real-Time Sign Language Interpretation via Customized Sign Language Gloves and Motion Retrieval

Chien-Hua Chen iD, Chih-Yuan Yao iD, Shih-Hsuan Hung iD

Sensors · 03.08.2026 · 26 (15) · 4884

DOI: 10.3390/s26154884 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 03.08.2026. Verfasst von Chien-Hua Chen und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Computer Science and Information Engineering, National Taiwan University of Science and Technology, Taipei 106335, Taiwan. Hauptthemen laut MEDLINE: Sign Language. Die Arbeit nennt 25 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

A sign language interpretation system aims to translate sign gestures into spoken or written language in real time, enabling signers and non-signers to communicate in their familiar linguistic forms. However, vision-based approaches suffer from hand occlusion, lighting variability, and complex backgrounds, while Deep Neural Network (DNN)-based methods incur heavy computational costs that hinder real-time use on resource-constrained platforms. In this paper, we propose sign language gloves and a lightweight motion retrieval method for real-time sign language interpretation that runs on mobile devices and embedded systems. The sign language gloves integrate flex sensors, an inertial measurement unit (IMU), and pressure sensors to accurately capture gesture features, including finger bending angles, hand orientation, movement trajectories, and fingertip contacts with body parts, enabling recognition of touch-based gestures. For the motion retrieval method, we build a comprehensive gesture dataset with the gloves and perform feature analysis on each sign language gesture to avoid redundant information in the dataset. During interpretation, our system employs a feature-labeling mechanism to ensure gesture distinguishability and a gesture retrieval algorithm to evaluate movement continuity and similarity. This allows the system to identify corresponding feature labels and consolidate them into complete sign language vocabulary entries. The proposed motion retrieval method is characterized by low computational complexity and a well-defined data structure. This makes it suitable for integration into embedded systems, offering real-time performance and high portability for practical deployment. In our experiments, the proposed system achieved an average recognition accuracy of 92% on a gesture dataset covering 300 sign language words.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Sign LanguageHumansGesturesAlgorithmsMotionMotion CaptureMovementNeural Networks, Computer

Stichwörter der Autor:innen

data glovemotion recognitionsign language interpretation system

Autor:innen und Institutionen

  • Department of Computer Science and Information Engineering, National Taiwan University of Science and Technology, Taipei 106335, Taiwan.
  • Department of Computer Science, National Tsing Hua University, Hsinchu 300044, Taiwan.

ORCID-Profile: Chien-Hua Chen, Chih-Yuan Yao, Shih-Hsuan Hung

Zitieren

APA

Chen, C. H., Yao, C. Y., & Hung, S. H. (2026). Real-Time Sign Language Interpretation via Customized Sign Language Gloves and Motion Retrieval. Sensors, 26(15), 4884. https://doi.org/10.3390/s26154884

Vancouver

Chen CH, Yao CY, Hung SH. Real-Time Sign Language Interpretation via Customized Sign Language Gloves and Motion Retrieval. Sensors. 2026;26(15):4884. doi:10.3390/s26154884

BibTeX
@article{Chen2026,
  author = {Chen, Chien-Hua and Yao, Chih-Yuan and Hung, Shih-Hsuan},
  title = {Real-Time Sign Language Interpretation via Customized Sign Language Gloves and Motion Retrieval},
  journal = {Sensors},
  year = {2026},
  volume = {26},
  number = {15},
  pages = {4884},
  doi = {10.3390/s26154884}
}
Kostenlos starten →