Can Large Language Models Simulate Spoken Human Conversations?
Cognitive Science · 2025-09 · 49 (9)
DOI: 10.1111/cogs.70106 ↗Kurz gefasst
Fachartikel in der Zeitschrift Cognitive Science, 2025-09. Verfasst von Eric Mayor und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychology, University of Basel. Hauptthemen laut MEDLINE: Language, Communication, Speech. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 74 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Large language models (LLMs) can emulate many aspects of human cognition and have been heralded as a potential paradigm shift. They are proficient in chat‐based conversation, but little is known about their ability to simulate spoken conversation. We investigated whether LLMs can simulate spoken human conversation. In Study 1, we compared transcripts of human telephone conversations from the Switchboard (SB) corpus to six corpora of transcripts generated by two powerful LLMs, GPT‐4 and Claude Sonnet 3.5, and two open‐source LLMs, Vicuna and Wayfarer, using different prompts designed to mimic SB participants’ instructions. We compared LLM and SB conversations in terms of alignment (conceptual, syntactic, and lexical), coordination markers, and coordination of openings and closings. We also documented qualitative features by which LLM conversations differ from SB conversations. In Study 2, we assessed whether humans can distinguish transcripts produced by LLMs from those of SB conversations. LLM conversations exhibited exaggerated alignment (and an increase in alignment as conversation unfolded) relative to human conversations, different and often inappropriate use of coordination markers, and were dissimilar to human conversations in openings and closings. LLM conversations did not consistently pass for SB conversations. Spoken conversations generated by LLMs are both qualitatively and quantitatively different from those of humans. This issue may evolve with better LLMs and more training on spoken conversation, but may also result from key differences between spoken conversation and chat.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Psychology, University of Basel.
- Department of Psychology, Norwegian University of Science and Technology.
- Institute of Work and Organizational Psychology, University of Neuchâtel.
Zitieren
APA
Mayor, E., Bietti, L. M., & Bangerter, A. (2025). Can Large Language Models Simulate Spoken Human Conversations?. Cognitive Science, 49(9). https://doi.org/10.1111/cogs.70106
Vancouver
Mayor E, Bietti LM, Bangerter A. Can Large Language Models Simulate Spoken Human Conversations?. Cognitive Science. 2025;49(9). doi:10.1111/cogs.70106
BibTeX
@article{Mayor2025,
author = {Mayor, Eric and Bietti, Lucas M and Bangerter, Adrian},
title = {Can Large Language Models Simulate Spoken Human Conversations?},
journal = {Cognitive Science},
year = {2025},
volume = {49},
number = {9},
doi = {10.1111/cogs.70106}
}
EUVIMED