A Study on the Performance of a RAG-Augmented Interview Chatbot
International Conference on Computers in Education · 01.12.2025
DOI: 10.58459/icce.2025.6096 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Conference on Computers in Education, online erschienen am 01.12.2025. Verfasst von Muhammad Rifat Anwar und 2 weiteren Autor:innen.
Abstract (Originalsprache)
Along with the increasing importance of communication skills for the jobseekers, many students face challenges in preparing for interviews, both in terms of knowledge, experience, and self-confidence. This research explores the effectiveness of a RAG-augmented chatbot for job interview preparation, combining information retrieval and large language models (LLMs) to generate contextually relevant responses. Two LLM models, Google/gemma-2-2b-it and deepseek-ai/DeepSeek-V3, were compared across three scenarios: True-True (TT), True-False (TF), and False-False (FF). Results show that DeepSeek-V3 outperformed Google/gemma-2-2b-it in generating more accurate and relevant responses, though both models struggled in False-False scenarios. The System Usability Scale (SUS) testing indicated that the chatbot was perceived as easy to use and effective, with scores above the average threshold of 68. However, feedback highlighted concerns regarding response time and the complexity of some features. Overall, the findings suggest that the RAG-based chatbot is a promising tool for interview preparation, though improvements in model performance, system responsiveness, and interface simplicity are recommended for future development.
Zitieren
APA
Anwar, M. R., Mashudi, I. A., & Yunhasnawa, Y. (2025). A Study on the Performance of a RAG-Augmented Interview Chatbot. International Conference on Computers in Education. https://doi.org/10.58459/icce.2025.6096
Vancouver
Anwar MR, Mashudi IA, Yunhasnawa Y. A Study on the Performance of a RAG-Augmented Interview Chatbot. International Conference on Computers in Education. 2025. doi:10.58459/icce.2025.6096
BibTeX
@article{Anwar2025,
author = {Anwar, Muhammad Rifat and Mashudi, Irsyad Arif and Yunhasnawa, Yoppy},
title = {A Study on the Performance of a RAG-Augmented Interview Chatbot},
journal = {International Conference on Computers in Education},
year = {2025},
doi = {10.58459/icce.2025.6096}
}
EUVIMED