Real-Time Sign Language Interpretation via Customized Sign Language Gloves and Motion Retrieval
Sensors · 03.08.2026 · 26 (15) · 4884
DOI: 10.3390/s26154884 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 03.08.2026. Verfasst von Chien-Hua Chen und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Computer Science and Information Engineering, National Taiwan University of Science and Technology, Taipei 106335, Taiwan. Hauptthemen laut MEDLINE: Sign Language. Die Arbeit nennt 25 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
A sign language interpretation system aims to translate sign gestures into spoken or written language in real time, enabling signers and non-signers to communicate in their familiar linguistic forms. However, vision-based approaches suffer from hand occlusion, lighting variability, and complex backgrounds, while Deep Neural Network (DNN)-based methods incur heavy computational costs that hinder real-time use on resource-constrained platforms. In this paper, we propose sign language gloves and a lightweight motion retrieval method for real-time sign language interpretation that runs on mobile devices and embedded systems. The sign language gloves integrate flex sensors, an inertial measurement unit (IMU), and pressure sensors to accurately capture gesture features, including finger bending angles, hand orientation, movement trajectories, and fingertip contacts with body parts, enabling recognition of touch-based gestures. For the motion retrieval method, we build a comprehensive gesture dataset with the gloves and perform feature analysis on each sign language gesture to avoid redundant information in the dataset. During interpretation, our system employs a feature-labeling mechanism to ensure gesture distinguishability and a gesture retrieval algorithm to evaluate movement continuity and similarity. This allows the system to identify corresponding feature labels and consolidate them into complete sign language vocabulary entries. The proposed motion retrieval method is characterized by low computational complexity and a well-defined data structure. This makes it suitable for integration into embedded systems, offering real-time performance and high portability for practical deployment. In our experiments, the proposed system achieved an average recognition accuracy of 92% on a gesture dataset covering 300 sign language words.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Computer Science and Information Engineering, National Taiwan University of Science and Technology, Taipei 106335, Taiwan.
- Department of Computer Science, National Tsing Hua University, Hsinchu 300044, Taiwan.
ORCID-Profile: Chien-Hua Chen, Chih-Yuan Yao, Shih-Hsuan Hung
Zitieren
APA
Chen, C. H., Yao, C. Y., & Hung, S. H. (2026). Real-Time Sign Language Interpretation via Customized Sign Language Gloves and Motion Retrieval. Sensors, 26(15), 4884. https://doi.org/10.3390/s26154884
Vancouver
Chen CH, Yao CY, Hung SH. Real-Time Sign Language Interpretation via Customized Sign Language Gloves and Motion Retrieval. Sensors. 2026;26(15):4884. doi:10.3390/s26154884
BibTeX
@article{Chen2026,
author = {Chen, Chien-Hua and Yao, Chih-Yuan and Hung, Shih-Hsuan},
title = {Real-Time Sign Language Interpretation via Customized Sign Language Gloves and Motion Retrieval},
journal = {Sensors},
year = {2026},
volume = {26},
number = {15},
pages = {4884},
doi = {10.3390/s26154884}
}
EUVIMED