EUVIMEDОткрийте EUVIMED
CrossrefИнфокарта

The SmartGlove BISINDO Wearable Sensor and Large Language Model–Based Sign Language–to-Speech System for Users With Communication Disorders: Design Science Research Study

Suhartono Suhartono, Bambang Yulianto, Burhanuddin Arafah, Kusubakti Andajani, Abdul Kholiq, Muhammad Ridha Anugrah Latief, Bambang Prastio, Diding Wahyudin Rohaedi, Deshinta Arrova Dewi, Taqdir Taqdir

JMIR Rehabilitation and Assistive Technologies · 2026-10-22 · 13 · e96258-e96258

DOI: 10.2196/96258 ↗
РезюмеБиблиографски данни

Резюме

Abstract Background In Indonesia, people with communication disorders predominantly communicate using Bahasa Isyarat Indonesia (BISINDO). Nevertheless, all current systems for BISINDO recognition generate fragmented, word-by-word output and lack natural language generation (NLG) capabilities, thereby fundamentally constraining their communicative utility. Objective The aim of this study is to develop, validate, and field-evaluate SmartGlove BISINDO, an AI-assisted wearable sign language–to-speech system that embeds large language model (LLM)–powered NLG into a BISINDO translation pipeline for the first time. Methods This study followed the design science research (DSR) framework, covering phases 1 through 5 (problem identification, solution objectives, prototype design and development, demonstration, and evaluation). Data were collected from 12 purposively selected informants (6 domain experts and 6 deaf education companions/teachers) across 3 Indonesian cities (Malang, Surabaya, and Makassar), using a needs-analysis questionnaire and an expert validation sheet, and analyzed through statistical triangulation of agreement percentage, content validity ratio (CVR), and Aiken V. The validated prototype was field-tested in Makassar and Malang with 15 participants with communication disorders and 4 observers or companions; it was evaluated by a disability expert in Surabaya. Results The needs analysis yielded a grand mean of 4.77 (SD 0.51) across 4 clusters, with 89% mean agreement, indicating very high priority for all identified needs. The prototype’s 5-layer architecture integrates wearable sensors, on-device gesture classification, and LLM-based NLG. Expert validation showed an overall Aiken V of 0.94, with all 14 items exceeding the 0.75 validity cutoff and with 11/14 items (79%) rated highly valid (V>0.90). The grand mean CVR was 0.76 (SD 0.16), exceeding the Lawshe minimum threshold of 0.56 ( P

Знание, съобразено с Вашата работа.

От безплатното начало през личното търсене на литература до пълния Research Suite.

Виж тарифите →

Включени ли са всички издателски пълни текстове?

Не. Библиографските записи, резюметата и пълните текстове са различни видове съдържание. Дали е наличен пълен текст зависи от източника, Open Access и вашите съществуващи лицензи. План на EUVIMED не заменя допълнителни издателски права.

Виж тарифите →