The SmartGlove BISINDO Wearable Sensor and Large Language Model–Based Sign Language–to-Speech System for Users With Communication Disorders: Design Science Research Study
JMIR Rehabilitation and Assistive Technologies · 22.10.2026 · 13 · e96258-e96258
DOI: 10.2196/96258 ↗Kurz gefasst
Fachartikel in der Zeitschrift JMIR Rehabilitation and Assistive Technologies, online erschienen am 22.10.2026. Verfasst von Suhartono Suhartono und 9 weiteren Autor:innen. Beteiligte Einrichtung: Department of Indonesian Language and Literature Education, Universitas Negeri Surabaya, Jalan Lidah Wetan, Lakarsantri, Surabaya, East Java, 60213, …. Die Arbeit nennt 42 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Background
In Indonesia, people with communication disorders predominantly communicate using Bahasa Isyarat Indonesia (BISINDO). Nevertheless, all current systems for BISINDO recognition generate fragmented, word-by-word output and lack natural language generation (NLG) capabilities, thereby fundamentally constraining their communicative utility.
Objective
The aim of this study is to develop, validate, and field-evaluate SmartGlove BISINDO, an AI-assisted wearable sign language–to-speech system that embeds large language model (LLM)–powered NLG into a BISINDO translation pipeline for the first time.
Methods
This study followed the design science research (DSR) framework, covering phases 1 through 5 (problem identification, solution objectives, prototype design and development, demonstration, and evaluation). Data were collected from 12 purposively selected informants (6 domain experts and 6 deaf education companions/teachers) across 3 Indonesian cities (Malang, Surabaya, and Makassar), using a needs-analysis questionnaire and an expert validation sheet, and analyzed through statistical triangulation of agreement percentage, content validity ratio (CVR), and Aiken V. The validated prototype was field-tested in Makassar and Malang with 15 participants with communication disorders and 4 observers or companions; it was evaluated by a disability expert in Surabaya.
Results
The needs analysis yielded a grand mean of 4.77 (SD 0.51) across 4 clusters, with 89% mean agreement, indicating very high priority for all identified needs. The prototype’s 5-layer architecture integrates wearable sensors, on-device gesture classification, and LLM-based NLG. Expert validation showed an overall Aiken V of 0.94, with all 14 items exceeding the 0.75 validity cutoff and with 11/14 items (79%) rated highly valid (V>0.90). The grand mean CVR was 0.76 (SD 0.16), exceeding the Lawshe minimum threshold of 0.56 ( P
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Indonesian Language and Literature Education, Universitas Negeri Surabaya, Jalan Lidah Wetan, Lakarsantri, Surabaya, East Java, 60213, Indonesia, +62 81330721085.
- Hasanuddin University, Makassar, South Sulawesi, Indonesia.
- State University of Malang, Malang, East Java, Indonesia.
- INTI International University, Putra Nilai, Negeri Sembilan, Malaysia.
Zitieren
APA
Suhartono, S., Yulianto, B., Arafah, B., Andajani, K., Kholiq, A., Latief, M. R. A., Prastio, B., Rohaedi, D. W., Dewi, D. A., & Taqdir, T. (2026). The SmartGlove BISINDO Wearable Sensor and Large Language Model–Based Sign Language–to-Speech System for Users With Communication Disorders: Design Science Research Study. JMIR Rehabilitation and Assistive Technologies, 13, e96258-e96258. https://doi.org/10.2196/96258
Vancouver
Suhartono S, Yulianto B, Arafah B, Andajani K, Kholiq A, Latief MRA, et al. The SmartGlove BISINDO Wearable Sensor and Large Language Model–Based Sign Language–to-Speech System for Users With Communication Disorders: Design Science Research Study. JMIR Rehabilitation and Assistive Technologies. 2026;13:e96258-e96258. doi:10.2196/96258
BibTeX
@article{Suhartono2026,
author = {Suhartono, Suhartono and Yulianto, Bambang and Arafah, Burhanuddin and Andajani, Kusubakti and Kholiq, Abdul and Latief, Muhammad Ridha Anugrah and Prastio, Bambang and Rohaedi, Diding Wahyudin and Dewi, Deshinta Arrova and Taqdir, Taqdir},
title = {The SmartGlove BISINDO Wearable Sensor and Large Language Model–Based Sign Language–to-Speech System for Users With Communication Disorders: Design Science Research Study},
journal = {JMIR Rehabilitation and Assistive Technologies},
year = {2026},
volume = {13},
pages = {e96258--e96258},
doi = {10.2196/96258}
}
EUVIMED