Voice-Enabled Virtual Patients for Interactive Training in Standardized Clinical Assessment: Mixed Methods Pilot Study
Journal of Medical Internet Research · 02.10.2026 · 28 · e89066-e89066
DOI: 10.2196/89066 ↗Kurz gefasst
Mixed-Methods-Studie in der Zeitschrift Journal of Medical Internet Research, online erschienen am 02.10.2026. Verfasst von Veronica Bossio Botero und 4 weiteren Autor:innen. Beteiligte Einrichtung: Brooklyn Health, 636 Broadway, Suite 301, New York, NY, 11201, United States, 1 917-284-8568. Hauptthemen laut MEDLINE: Patient Simulation, User-Computer Interface. Die Arbeit nennt 28 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Background
Training mental health clinicians to conduct standardized clinical assessments is challenging due to a lack of scalable, realistic practice opportunities. Traditional methods often fail to prepare trainees for the variability and complexity of real-world patient interactions, potentially impacting data quality in clinical trials. This paper introduces a novel approach to address this training gap using large language model (LLM)–based interview simulations.
Objective
This study aimed to develop and validate a voice-enabled virtual patient simulation system as a proof of concept. We described the development of the system and evaluated whether it could generate virtual patients that (1) accurately adhered to predefined clinical profiles, (2) maintained a coherent and consistent narrative, and (3) produced dialogue that is perceived as realistic.
Methods
We implemented a system that used an LLM to simulate patients with specified symptom profiles, demographic backgrounds, and distinct communication styles. The system’s performance was analyzed through a mixed methods evaluation, which included a formal assessment by 5 experienced clinical raters who conducted simulated structured Montgomery-Åsberg Depression Rating Scale (MADRS) interviews with 4 virtual patient personae, scored them on the scale, and provided qualitative feedback on the system’s clinical plausibility, narrative cohesion, and dialogue realism.
Results
Across 20 interviews, the virtual patients demonstrated reasonable adherence to their configured clinical profiles, with human rater scores falling near their predefined score configurations. The mean item difference between MADRS rater scores and configured scores was 0.52 (SD 0.75); interrater reliability for the total score was 0.90 (95% CI 0.68‐0.99). Expert raters consistently gave average ratings of “agree” to “strongly agree” when asked to evaluate the qualitative realism and cohesion of the virtual patients.
Conclusions
LLM-powered virtual patient simulations offered a promising, scalable tool for training clinicians in standardized clinical assessment. This pilot study provides initial evidence for the system’s ability to produce clinically relevant practice scenarios with reasonable fidelity.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Brooklyn Health, 636 Broadway, Suite 301, New York, NY, 11201, United States, 1 917-284-8568.
- School of Psychology, University of New South Wales, Sydney, NA, Australia.
- Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States.
Zitieren
APA
Bossio Botero, V., Yadav, V., Ouyang, J., Abbas, A., & Worthington, M. (2026). Voice-Enabled Virtual Patients for Interactive Training in Standardized Clinical Assessment: Mixed Methods Pilot Study. Journal of Medical Internet Research, 28, e89066-e89066. https://doi.org/10.2196/89066
Vancouver
Bossio Botero V, Yadav V, Ouyang J, Abbas A, Worthington M. Voice-Enabled Virtual Patients for Interactive Training in Standardized Clinical Assessment: Mixed Methods Pilot Study. Journal of Medical Internet Research. 2026;28:e89066-e89066. doi:10.2196/89066
BibTeX
@article{BossioBotero2026,
author = {Bossio Botero, Veronica and Yadav, Vijay and Ouyang, Jacob and Abbas, Anzar and Worthington, Michelle},
title = {Voice-Enabled Virtual Patients for Interactive Training in Standardized Clinical Assessment: Mixed Methods Pilot Study},
journal = {Journal of Medical Internet Research},
year = {2026},
volume = {28},
pages = {e89066--e89066},
doi = {10.2196/89066}
}
EUVIMED