EUVIMEDEUVIMED entdecken
Open Access

The SmartGlove BISINDO Wearable Sensor and Large Language Model–Based Sign Language–to-Speech System for Users With Communication Disorders: Design Science Research Study

Suhartono Suhartono, Bambang Yulianto, Burhanuddin Arafah, Kusubakti Andajani, Abdul Kholiq, Muhammad Ridha Anugrah Latief, Bambang Prastio, Diding Wahyudin Rohaedi, Deshinta Arrova Dewi, Taqdir Taqdir

JMIR Rehabilitation and Assistive Technologies · 22.10.2026 · 13 · e96258-e96258

DOI: 10.2196/96258 ↗

Kurz gefasst

Fachartikel in der Zeitschrift JMIR Rehabilitation and Assistive Technologies, online erschienen am 22.10.2026. Verfasst von Suhartono Suhartono und 9 weiteren Autor:innen. Beteiligte Einrichtung: Department of Indonesian Language and Literature Education, Universitas Negeri Surabaya, Jalan Lidah Wetan, Lakarsantri, Surabaya, East Java, 60213, …. Die Arbeit nennt 42 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

In Indonesia, people with communication disorders predominantly communicate using Bahasa Isyarat Indonesia (BISINDO). Nevertheless, all current systems for BISINDO recognition generate fragmented, word-by-word output and lack natural language generation (NLG) capabilities, thereby fundamentally constraining their communicative utility.

Objective

The aim of this study is to develop, validate, and field-evaluate SmartGlove BISINDO, an AI-assisted wearable sign language–to-speech system that embeds large language model (LLM)–powered NLG into a BISINDO translation pipeline for the first time.

Methods

This study followed the design science research (DSR) framework, covering phases 1 through 5 (problem identification, solution objectives, prototype design and development, demonstration, and evaluation). Data were collected from 12 purposively selected informants (6 domain experts and 6 deaf education companions/teachers) across 3 Indonesian cities (Malang, Surabaya, and Makassar), using a needs-analysis questionnaire and an expert validation sheet, and analyzed through statistical triangulation of agreement percentage, content validity ratio (CVR), and Aiken V. The validated prototype was field-tested in Makassar and Malang with 15 participants with communication disorders and 4 observers or companions; it was evaluated by a disability expert in Surabaya.

Results

The needs analysis yielded a grand mean of 4.77 (SD 0.51) across 4 clusters, with 89% mean agreement, indicating very high priority for all identified needs. The prototype’s 5-layer architecture integrates wearable sensors, on-device gesture classification, and LLM-based NLG. Expert validation showed an overall Aiken V of 0.94, with all 14 items exceeding the 0.75 validity cutoff and with 11/14 items (79%) rated highly valid (V>0.90). The grand mean CVR was 0.76 (SD 0.16), exceeding the Lawshe minimum threshold of 0.56 ( P

Schlagwörter

Stichwörter der Autor:innen

BISINDOBahasa Isyarat Indonesiaassistive communication technologyaugmentative and alternative communicationcommunication disordersinclusive technologylarge language modelnatural language generationprocess innovationsign language recognitionwearable sensing system

Autor:innen und Institutionen

  • Department of Indonesian Language and Literature Education, Universitas Negeri Surabaya, Jalan Lidah Wetan, Lakarsantri, Surabaya, East Java, 60213, Indonesia, +62 81330721085.
  • Hasanuddin University, Makassar, South Sulawesi, Indonesia.
  • State University of Malang, Malang, East Java, Indonesia.
  • INTI International University, Putra Nilai, Negeri Sembilan, Malaysia.

Zitieren

APA

Suhartono, S., Yulianto, B., Arafah, B., Andajani, K., Kholiq, A., Latief, M. R. A., Prastio, B., Rohaedi, D. W., Dewi, D. A., & Taqdir, T. (2026). The SmartGlove BISINDO Wearable Sensor and Large Language Model–Based Sign Language–to-Speech System for Users With Communication Disorders: Design Science Research Study. JMIR Rehabilitation and Assistive Technologies, 13, e96258-e96258. https://doi.org/10.2196/96258

Vancouver

Suhartono S, Yulianto B, Arafah B, Andajani K, Kholiq A, Latief MRA, et al. The SmartGlove BISINDO Wearable Sensor and Large Language Model–Based Sign Language–to-Speech System for Users With Communication Disorders: Design Science Research Study. JMIR Rehabilitation and Assistive Technologies. 2026;13:e96258-e96258. doi:10.2196/96258

BibTeX
@article{Suhartono2026,
  author = {Suhartono, Suhartono and Yulianto, Bambang and Arafah, Burhanuddin and Andajani, Kusubakti and Kholiq, Abdul and Latief, Muhammad Ridha Anugrah and Prastio, Bambang and Rohaedi, Diding Wahyudin and Dewi, Deshinta Arrova and Taqdir, Taqdir},
  title = {The SmartGlove BISINDO Wearable Sensor and Large Language Model–Based Sign Language–to-Speech System for Users With Communication Disorders: Design Science Research Study},
  journal = {JMIR Rehabilitation and Assistive Technologies},
  year = {2026},
  volume = {13},
  pages = {e96258--e96258},
  doi = {10.2196/96258}
}
Kostenlos starten →