EUVIMEDOntdek EUVIMED
CrossrefInfokaart

The SmartGlove BISINDO Wearable Sensor and Large Language Model–Based Sign Language–to-Speech System for Users With Communication Disorders: Design Science Research Study

Suhartono Suhartono, Bambang Yulianto, Burhanuddin Arafah, Kusubakti Andajani, Abdul Kholiq, Muhammad Ridha Anugrah Latief, Bambang Prastio, Diding Wahyudin Rohaedi, Deshinta Arrova Dewi, Taqdir Taqdir

JMIR Rehabilitation and Assistive Technologies · 2026-10-22 · 13 · e96258-e96258

DOI: 10.2196/96258 ↗
SamenvattingBibliografische gegevens

Samenvatting

Abstract Background In Indonesia, people with communication disorders predominantly communicate using Bahasa Isyarat Indonesia (BISINDO). Nevertheless, all current systems for BISINDO recognition generate fragmented, word-by-word output and lack natural language generation (NLG) capabilities, thereby fundamentally constraining their communicative utility. Objective The aim of this study is to develop, validate, and field-evaluate SmartGlove BISINDO, an AI-assisted wearable sign language–to-speech system that embeds large language model (LLM)–powered NLG into a BISINDO translation pipeline for the first time. Methods This study followed the design science research (DSR) framework, covering phases 1 through 5 (problem identification, solution objectives, prototype design and development, demonstration, and evaluation). Data were collected from 12 purposively selected informants (6 domain experts and 6 deaf education companions/teachers) across 3 Indonesian cities (Malang, Surabaya, and Makassar), using a needs-analysis questionnaire and an expert validation sheet, and analyzed through statistical triangulation of agreement percentage, content validity ratio (CVR), and Aiken V. The validated prototype was field-tested in Makassar and Malang with 15 participants with communication disorders and 4 observers or companions; it was evaluated by a disability expert in Surabaya. Results The needs analysis yielded a grand mean of 4.77 (SD 0.51) across 4 clusters, with 89% mean agreement, indicating very high priority for all identified needs. The prototype’s 5-layer architecture integrates wearable sensors, on-device gesture classification, and LLM-based NLG. Expert validation showed an overall Aiken V of 0.94, with all 14 items exceeding the 0.75 validity cutoff and with 11/14 items (79%) rated highly valid (V>0.90). The grand mean CVR was 0.76 (SD 0.16), exceeding the Lawshe minimum threshold of 0.56 ( P

Kennis die bij uw werk past.

Van een gratis start via persoonlijk literatuuronderzoek tot de volledige Research Suite.

Tarieven bekijken →

Zijn alle volledige uitgeversteksten inbegrepen?

Nee. Bibliografische records, abstracts en volledige teksten zijn verschillende inhoudstypen. Beschikbaarheid hangt af van bron, open access en bestaande licenties. Een EUVIMED-abonnement vervangt geen aanvullende uitgeversrechten.

Tarieven bekijken →