Hospital Sign Dialogue Translation for Intake Interviews Using Visual Prompt Adaptation
Journal of Clinical Practice and Health Sciences · 25.06.2026 · 6 (1) · 184-193
DOI: 10.71465/jcphs58 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Clinical Practice and Health Sciences, online erschienen am 25.06.2026. Verfasst von Elise Moulin und 3 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Communication barriers between deaf or hard-of-hearing patients and hearing healthcare professionals during medical intake interviews represent a critical vulnerability in global healthcare delivery. Traditional human interpretation services, while highly accurate, are frequently constrained by availability, high costs, and privacy concerns, particularly in urgent or sensitive clinical scenarios. Recent advancements in automated sign language translation offer a promising alternative; however, deploying these systems in hospital environments introduces severe domain shifts. Clinical settings are characterized by complex visual backgrounds, unpredictable lighting conditions, occlusion from medical equipment, and varying patient postures, which collectively degrade the performance of standard translation models. This paper proposes a comprehensive framework for hospital sign-dialogue translation integrated with visual prompt adaptation to mitigate these environmental challenges. By injecting learnable visual prompts into the encoding phase of a transformer-based translation architecture, the system dynamically recalibrates its spatial-temporal focus, effectively filtering out extraneous clinical noise while preserving fine-grained manual and non-manual sign features. The proposed approach specifically targets the intake interview domain, modeling multi-turn dialogues to contextualize isolated signs within broader clinical narratives. Extensive evaluations on a specialized clinical sign language dataset demonstrate that visual prompt adaptation significantly improves translation accuracy, robustness, and clinical utility compared to traditional baseline models. The findings indicate that tailored multimodal architectures can successfully bridge the communication gap in acute care settings, facilitating equitable healthcare access and improving diagnostic accuracy for marginalized patient populations.
Zitieren
APA
Moulin, E., Turner, H., Keller, S., & Rey, T. (2026). Hospital Sign Dialogue Translation for Intake Interviews Using Visual Prompt Adaptation. Journal of Clinical Practice and Health Sciences, 6(1), 184-193. https://doi.org/10.71465/jcphs58
Vancouver
Moulin E, Turner H, Keller S, Rey T. Hospital Sign Dialogue Translation for Intake Interviews Using Visual Prompt Adaptation. Journal of Clinical Practice and Health Sciences. 2026;6(1):184-193. doi:10.71465/jcphs58
BibTeX
@article{Moulin2026,
author = {Moulin, Elise and Turner, Hazel and Keller, Simon and Rey, Theo},
title = {Hospital Sign Dialogue Translation for Intake Interviews Using Visual Prompt Adaptation},
journal = {Journal of Clinical Practice and Health Sciences},
year = {2026},
volume = {6},
number = {1},
pages = {184--193},
doi = {10.71465/jcphs58}
}
EUVIMED