EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Human‐ versus artificial intelligence‐delivered roleplay tasks for assessing interactional competence: An applied conversation analytic study

Masaki Eguchi, Kotaro Takizawa, Mao Saeki, Fuma Kurata, Shungo Suzuki, Yoichi Matsuyama, Yasuyo Sawaki

TESOL Quarterly · 2025-12 · 59 (S1)

DOI: 10.1002/tesq.70028 ↗

Kurz gefasst

Fachartikel in der Zeitschrift TESOL Quarterly, online erschienen am 25.09.2025. Verfasst von Masaki Eguchi und 6 weiteren Autor:innen. Die Arbeit wurde bisher 19-mal zitiert (Crossref) und nennt 53 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: New Energy and Industrial Technology Development Organization.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study investigates the nature of co‐construction in roleplays conducted with human versus AI interlocutors for assessing interactional competence (IC) in L2 English. Seventy‐five university students in Japan completed roleplay tasks with both human tutors and an AI agent. The AI agent is a multimodal dialog system integrated with a large language model (LLM), designed to allow synchronous interaction with the participant through autonomous turn‐taking. Using conversation analysis, 24 interactions were analyzed to investigate how participants managed preference organization, sequence expansion, and turn‐taking. The analysis revealed that the AI‐delivered roleplays elicited some IC‐relevant practices and that participants treated the roleplay as a co‐constructed interaction, responding contingently to the AI's contributions. While the data suggested both human and AI interlocutors maintained mutual understanding, striking differences in turn‐taking practices were observed, including more frequent overlaps and inter‐turn gaps in the AI‐delivered condition. The study concludes that LLM‐integrated multimodal dialog systems, by producing recognizable verbal actions and multimodal signals, have the potential to effectively elicit co‐constructed interactional performances relevant to IC assessment.

Förderung

  • New Energy and Industrial Technology Development Organization

Zitieren

APA

Eguchi, M., Takizawa, K., Saeki, M., Kurata, F., Suzuki, S., Matsuyama, Y., & Sawaki, Y. (2025). Human‐ versus artificial intelligence‐delivered roleplay tasks for assessing interactional competence: An applied conversation analytic study. TESOL Quarterly, 59(S1). https://doi.org/10.1002/tesq.70028

Vancouver

Eguchi M, Takizawa K, Saeki M, Kurata F, Suzuki S, Matsuyama Y, et al. Human‐ versus artificial intelligence‐delivered roleplay tasks for assessing interactional competence: An applied conversation analytic study. TESOL Quarterly. 2025;59(S1). doi:10.1002/tesq.70028

BibTeX
@article{Eguchi2025,
  author = {Eguchi, Masaki and Takizawa, Kotaro and Saeki, Mao and Kurata, Fuma and Suzuki, Shungo and Matsuyama, Yoichi and Sawaki, Yasuyo},
  title = {Human‐ versus artificial intelligence‐delivered roleplay tasks for assessing interactional competence: An applied conversation analytic study},
  journal = {TESOL Quarterly},
  year = {2025},
  volume = {59},
  number = {S1},
  doi = {10.1002/tesq.70028}
}
Kostenlos starten →