Human‐ versus artificial intelligence‐delivered roleplay tasks for assessing interactional competence: An applied conversation analytic study
TESOL Quarterly · 2025-12 · 59 (S1)
DOI: 10.1002/tesq.70028 ↗Kurz gefasst
Fachartikel in der Zeitschrift TESOL Quarterly, online erschienen am 25.09.2025. Verfasst von Masaki Eguchi und 6 weiteren Autor:innen. Die Arbeit wurde bisher 19-mal zitiert (Crossref) und nennt 53 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: New Energy and Industrial Technology Development Organization.
Abstract (Originalsprache)
This study investigates the nature of co‐construction in roleplays conducted with human versus AI interlocutors for assessing interactional competence (IC) in L2 English. Seventy‐five university students in Japan completed roleplay tasks with both human tutors and an AI agent. The AI agent is a multimodal dialog system integrated with a large language model (LLM), designed to allow synchronous interaction with the participant through autonomous turn‐taking. Using conversation analysis, 24 interactions were analyzed to investigate how participants managed preference organization, sequence expansion, and turn‐taking. The analysis revealed that the AI‐delivered roleplays elicited some IC‐relevant practices and that participants treated the roleplay as a co‐constructed interaction, responding contingently to the AI's contributions. While the data suggested both human and AI interlocutors maintained mutual understanding, striking differences in turn‐taking practices were observed, including more frequent overlaps and inter‐turn gaps in the AI‐delivered condition. The study concludes that LLM‐integrated multimodal dialog systems, by producing recognizable verbal actions and multimodal signals, have the potential to effectively elicit co‐constructed interactional performances relevant to IC assessment.
Förderung
- New Energy and Industrial Technology Development Organization
Zitieren
APA
Eguchi, M., Takizawa, K., Saeki, M., Kurata, F., Suzuki, S., Matsuyama, Y., & Sawaki, Y. (2025). Human‐ versus artificial intelligence‐delivered roleplay tasks for assessing interactional competence: An applied conversation analytic study. TESOL Quarterly, 59(S1). https://doi.org/10.1002/tesq.70028
Vancouver
Eguchi M, Takizawa K, Saeki M, Kurata F, Suzuki S, Matsuyama Y, et al. Human‐ versus artificial intelligence‐delivered roleplay tasks for assessing interactional competence: An applied conversation analytic study. TESOL Quarterly. 2025;59(S1). doi:10.1002/tesq.70028
BibTeX
@article{Eguchi2025,
author = {Eguchi, Masaki and Takizawa, Kotaro and Saeki, Mao and Kurata, Fuma and Suzuki, Shungo and Matsuyama, Yoichi and Sawaki, Yasuyo},
title = {Human‐ versus artificial intelligence‐delivered roleplay tasks for assessing interactional competence: An applied conversation analytic study},
journal = {TESOL Quarterly},
year = {2025},
volume = {59},
number = {S1},
doi = {10.1002/tesq.70028}
}
EUVIMED