EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Hospital Sign Dialogue Translation for Intake Interviews Using Visual Prompt Adaptation

Elise Moulin, Hazel Turner, Simon Keller, Theo Rey

Journal of Clinical Practice and Health Sciences · 25.06.2026 · 6 (1) · 184-193

DOI: 10.71465/jcphs58 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Clinical Practice and Health Sciences, online erschienen am 25.06.2026. Verfasst von Elise Moulin und 3 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Communication barriers between deaf or hard-of-hearing patients and hearing healthcare professionals during medical intake interviews represent a critical vulnerability in global healthcare delivery. Traditional human interpretation services, while highly accurate, are frequently constrained by availability, high costs, and privacy concerns, particularly in urgent or sensitive clinical scenarios. Recent advancements in automated sign language translation offer a promising alternative; however, deploying these systems in hospital environments introduces severe domain shifts. Clinical settings are characterized by complex visual backgrounds, unpredictable lighting conditions, occlusion from medical equipment, and varying patient postures, which collectively degrade the performance of standard translation models. This paper proposes a comprehensive framework for hospital sign-dialogue translation integrated with visual prompt adaptation to mitigate these environmental challenges. By injecting learnable visual prompts into the encoding phase of a transformer-based translation architecture, the system dynamically recalibrates its spatial-temporal focus, effectively filtering out extraneous clinical noise while preserving fine-grained manual and non-manual sign features. The proposed approach specifically targets the intake interview domain, modeling multi-turn dialogues to contextualize isolated signs within broader clinical narratives. Extensive evaluations on a specialized clinical sign language dataset demonstrate that visual prompt adaptation significantly improves translation accuracy, robustness, and clinical utility compared to traditional baseline models. The findings indicate that tailored multimodal architectures can successfully bridge the communication gap in acute care settings, facilitating equitable healthcare access and improving diagnostic accuracy for marginalized patient populations.

Zitieren

APA

Moulin, E., Turner, H., Keller, S., & Rey, T. (2026). Hospital Sign Dialogue Translation for Intake Interviews Using Visual Prompt Adaptation. Journal of Clinical Practice and Health Sciences, 6(1), 184-193. https://doi.org/10.71465/jcphs58

Vancouver

Moulin E, Turner H, Keller S, Rey T. Hospital Sign Dialogue Translation for Intake Interviews Using Visual Prompt Adaptation. Journal of Clinical Practice and Health Sciences. 2026;6(1):184-193. doi:10.71465/jcphs58

BibTeX
@article{Moulin2026,
  author = {Moulin, Elise and Turner, Hazel and Keller, Simon and Rey, Theo},
  title = {Hospital Sign Dialogue Translation for Intake Interviews Using Visual Prompt Adaptation},
  journal = {Journal of Clinical Practice and Health Sciences},
  year = {2026},
  volume = {6},
  number = {1},
  pages = {184--193},
  doi = {10.71465/jcphs58}
}
Kostenlos starten →