A Systematic Approach to Evaluate the Use of Chatbots in Educational Contexts: Learning Gains, Engagements and Perceptions
Computers · 09.07.2025 · 14 (7) · 270
DOI: 10.3390/computers14070270 ↗Kurz gefasst
Fachartikel in der Zeitschrift Computers, online erschienen am 09.07.2025. Verfasst von Wei Qiu und 7 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 64 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
As generative artificial intelligence (GenAI) chatbots gain traction in educational settings, a growing number of studies explore their potential for personalized, scalable learning. However, methodological fragmentation has limited the comparability and generalizability of findings across the field. This study proposes a unified, learning analytics–driven framework for evaluating the impact of GenAI chatbots on student learning. Grounded in the collection, analysis, and interpretation of diverse learner data, the framework integrates assessment outcomes, conversational interactions, engagement metrics, and student feedback. We demonstrate its application through a multi-week, quasi-experimental study using a Socratic-style chatbot designed with pedagogical intent. Using clustering techniques and statistical analysis, we identified patterns in student–chatbot interaction and linked them to changes in learning outcomes. This framework provides researchers and educators with a replicable structure for evaluating GenAI interventions and advancing coherence in learning analytics–based educational research.
Zitieren
APA
Qiu, W., Su, C. L., Jamil, N. B., Thway, M., Ng, S. S. H., Zhang, L., Lim, F. S., & Lai, J. W. (2025). A Systematic Approach to Evaluate the Use of Chatbots in Educational Contexts: Learning Gains, Engagements and Perceptions. Computers, 14(7), 270. https://doi.org/10.3390/computers14070270
Vancouver
Qiu W, Su CL, Jamil NB, Thway M, Ng SSH, Zhang L, et al. A Systematic Approach to Evaluate the Use of Chatbots in Educational Contexts: Learning Gains, Engagements and Perceptions. Computers. 2025;14(7):270. doi:10.3390/computers14070270
BibTeX
@article{Qiu2025,
author = {Qiu, Wei and Su, Chit Lin and Jamil, Nurabidah Binti and Thway, Maung and Ng, Samuel Soo Hwee and Zhang, Lei and Lim, Fun Siong and Lai, Joel Weijia},
title = {A Systematic Approach to Evaluate the Use of Chatbots in Educational Contexts: Learning Gains, Engagements and Perceptions},
journal = {Computers},
year = {2025},
volume = {14},
number = {7},
pages = {270},
doi = {10.3390/computers14070270}
}
EUVIMED