EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Systematic Approach to Evaluate the Use of Chatbots in Educational Contexts: Learning Gains, Engagements and Perceptions

Wei Qiu, Chit Lin Su, Nurabidah Binti Jamil, Maung Thway, Samuel Soo Hwee Ng, Lei Zhang, Fun Siong Lim, Joel Weijia Lai

Computers · 09.07.2025 · 14 (7) · 270

DOI: 10.3390/computers14070270 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computers, online erschienen am 09.07.2025. Verfasst von Wei Qiu und 7 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 64 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

As generative artificial intelligence (GenAI) chatbots gain traction in educational settings, a growing number of studies explore their potential for personalized, scalable learning. However, methodological fragmentation has limited the comparability and generalizability of findings across the field. This study proposes a unified, learning analytics–driven framework for evaluating the impact of GenAI chatbots on student learning. Grounded in the collection, analysis, and interpretation of diverse learner data, the framework integrates assessment outcomes, conversational interactions, engagement metrics, and student feedback. We demonstrate its application through a multi-week, quasi-experimental study using a Socratic-style chatbot designed with pedagogical intent. Using clustering techniques and statistical analysis, we identified patterns in student–chatbot interaction and linked them to changes in learning outcomes. This framework provides researchers and educators with a replicable structure for evaluating GenAI interventions and advancing coherence in learning analytics–based educational research.

Zitieren

APA

Qiu, W., Su, C. L., Jamil, N. B., Thway, M., Ng, S. S. H., Zhang, L., Lim, F. S., & Lai, J. W. (2025). A Systematic Approach to Evaluate the Use of Chatbots in Educational Contexts: Learning Gains, Engagements and Perceptions. Computers, 14(7), 270. https://doi.org/10.3390/computers14070270

Vancouver

Qiu W, Su CL, Jamil NB, Thway M, Ng SSH, Zhang L, et al. A Systematic Approach to Evaluate the Use of Chatbots in Educational Contexts: Learning Gains, Engagements and Perceptions. Computers. 2025;14(7):270. doi:10.3390/computers14070270

BibTeX
@article{Qiu2025,
  author = {Qiu, Wei and Su, Chit Lin and Jamil, Nurabidah Binti and Thway, Maung and Ng, Samuel Soo Hwee and Zhang, Lei and Lim, Fun Siong and Lai, Joel Weijia},
  title = {A Systematic Approach to Evaluate the Use of Chatbots in Educational Contexts: Learning Gains, Engagements and Perceptions},
  journal = {Computers},
  year = {2025},
  volume = {14},
  number = {7},
  pages = {270},
  doi = {10.3390/computers14070270}
}
Kostenlos starten →