EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Can Large Language Models Simulate Spoken Human Conversations?

Eric Mayor, Lucas M Bietti, Adrian Bangerter

Cognitive Science · 2025-09 · 49 (9)

DOI: 10.1111/cogs.70106 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Cognitive Science, 2025-09. Verfasst von Eric Mayor und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychology, University of Basel. Hauptthemen laut MEDLINE: Language, Communication, Speech. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 74 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Large language models (LLMs) can emulate many aspects of human cognition and have been heralded as a potential paradigm shift. They are proficient in chat‐based conversation, but little is known about their ability to simulate spoken conversation. We investigated whether LLMs can simulate spoken human conversation. In Study 1, we compared transcripts of human telephone conversations from the Switchboard (SB) corpus to six corpora of transcripts generated by two powerful LLMs, GPT‐4 and Claude Sonnet 3.5, and two open‐source LLMs, Vicuna and Wayfarer, using different prompts designed to mimic SB participants’ instructions. We compared LLM and SB conversations in terms of alignment (conceptual, syntactic, and lexical), coordination markers, and coordination of openings and closings. We also documented qualitative features by which LLM conversations differ from SB conversations. In Study 2, we assessed whether humans can distinguish transcripts produced by LLMs from those of SB conversations. LLM conversations exhibited exaggerated alignment (and an increase in alignment as conversation unfolded) relative to human conversations, different and often inappropriate use of coordination markers, and were dissimilar to human conversations in openings and closings. LLM conversations did not consistently pass for SB conversations. Spoken conversations generated by LLMs are both qualitatively and quantitatively different from those of humans. This issue may evolve with better LLMs and more training on spoken conversation, but may also result from key differences between spoken conversation and chat.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

LanguageCommunicationSpeechHumansFemaleMaleAdultLarge Language Models

Stichwörter der Autor:innen

Computational methodsConversational coordinationLLM to LLM conversationLinguistic alignmentSpoken conversation

Autor:innen und Institutionen

  • Department of Psychology, University of Basel.
  • Department of Psychology, Norwegian University of Science and Technology.
  • Institute of Work and Organizational Psychology, University of Neuchâtel.

Zitieren

APA

Mayor, E., Bietti, L. M., & Bangerter, A. (2025). Can Large Language Models Simulate Spoken Human Conversations?. Cognitive Science, 49(9). https://doi.org/10.1111/cogs.70106

Vancouver

Mayor E, Bietti LM, Bangerter A. Can Large Language Models Simulate Spoken Human Conversations?. Cognitive Science. 2025;49(9). doi:10.1111/cogs.70106

BibTeX
@article{Mayor2025,
  author = {Mayor, Eric and Bietti, Lucas M and Bangerter, Adrian},
  title = {Can Large Language Models Simulate Spoken Human Conversations?},
  journal = {Cognitive Science},
  year = {2025},
  volume = {49},
  number = {9},
  doi = {10.1111/cogs.70106}
}
Kostenlos starten →