EUVIMEDEUVIMED entdecken
Crossref

A Study on the Performance of a RAG-Augmented Interview Chatbot

Muhammad Rifat Anwar, Irsyad Arif Mashudi, Yoppy Yunhasnawa

International Conference on Computers in Education · 01.12.2025

DOI: 10.58459/icce.2025.6096 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Conference on Computers in Education, online erschienen am 01.12.2025. Verfasst von Muhammad Rifat Anwar und 2 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Along with the increasing importance of communication skills for the jobseekers, many students face challenges in preparing for interviews, both in terms of knowledge, experience, and self-confidence. This research explores the effectiveness of a RAG-augmented chatbot for job interview preparation, combining information retrieval and large language models (LLMs) to generate contextually relevant responses. Two LLM models, Google/gemma-2-2b-it and deepseek-ai/DeepSeek-V3, were compared across three scenarios: True-True (TT), True-False (TF), and False-False (FF). Results show that DeepSeek-V3 outperformed Google/gemma-2-2b-it in generating more accurate and relevant responses, though both models struggled in False-False scenarios. The System Usability Scale (SUS) testing indicated that the chatbot was perceived as easy to use and effective, with scores above the average threshold of 68. However, feedback highlighted concerns regarding response time and the complexity of some features. Overall, the findings suggest that the RAG-based chatbot is a promising tool for interview preparation, though improvements in model performance, system responsiveness, and interface simplicity are recommended for future development.

Zitieren

APA

Anwar, M. R., Mashudi, I. A., & Yunhasnawa, Y. (2025). A Study on the Performance of a RAG-Augmented Interview Chatbot. International Conference on Computers in Education. https://doi.org/10.58459/icce.2025.6096

Vancouver

Anwar MR, Mashudi IA, Yunhasnawa Y. A Study on the Performance of a RAG-Augmented Interview Chatbot. International Conference on Computers in Education. 2025. doi:10.58459/icce.2025.6096

BibTeX
@article{Anwar2025,
  author = {Anwar, Muhammad Rifat and Mashudi, Irsyad Arif and Yunhasnawa, Yoppy},
  title = {A Study on the Performance of a RAG-Augmented Interview Chatbot},
  journal = {International Conference on Computers in Education},
  year = {2025},
  doi = {10.58459/icce.2025.6096}
}
Kostenlos starten →