EUVIMEDEUVIMED entdecken
Crossref

Using a RAG-enhanced large language model in a virtual teaching assistant role: Experiences from a pilot project in statistics education

Renáta Németh, Annamária Tátrai, Miklós Szabó, Árpád Tamási

Hungarian Statistical Review · 2024 · 7 (2) · 3-27

DOI: 10.35618/hsr2024.02.en003 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Hungarian Statistical Review, 2024. Verfasst von Renáta Németh und 3 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The role of artificial intelligence (AI) in education is expected to grow, but how it transforms teaching and learning remains unclear. This study explores the use of an AI tutor that is similar to ChatGPT enhanced with retrieval-augmented generation (RAG), in a pilot project at the Faculty of Social Sciences of Eötvös Loránd University in Budapest, Hungary. The tutor provided a searchable knowledge base for students preparing for admission to the MSc in Survey Statistics and Data Analytics. Instructor feedback highlighted the tutor’s ability to deliver accurate, textbook-based responses, but noted limitations in addressing real-world complexities. Student feedback, which was gathered through focus groups and surveys, showed high satisfaction and many used the tool for active learning such as comparing concepts and organising material. Students had the flexibility to adapt the tutor to their own learning strategy, and they also noted the importance of the tutor as a time-saving supplement rather than a replacement for comprehensive study. Approximately 15% of student queries demonstrated critical thinking, where students used the AI tutor to confirm their own interpretations. Similarly, around 15% showed active learning, seeking explanations and comparisons or generated study guides, while nearly 30% engaged directly with course material, referencing specific concepts and theories from their readings. Instructor evaluation revealed that 76% of the AI tutor’s responses were fully correct, 17% mostly correct and only 6% were misleading. The findings suggest that RAG models hold promise for enhancing learning by offering reliable, interactive and efficient support for students and educators.

Zitieren

APA

Németh, R., Tátrai, A., Szabó, M., & Tamási, Á. (2024). Using a RAG-enhanced large language model in a virtual teaching assistant role: Experiences from a pilot project in statistics education. Hungarian Statistical Review, 7(2), 3-27. https://doi.org/10.35618/hsr2024.02.en003

Vancouver

Németh R, Tátrai A, Szabó M, Tamási Á. Using a RAG-enhanced large language model in a virtual teaching assistant role: Experiences from a pilot project in statistics education. Hungarian Statistical Review. 2024;7(2):3-27. doi:10.35618/hsr2024.02.en003

BibTeX
@article{Nmeth2024,
  author = {Németh, Renáta and Tátrai, Annamária and Szabó, Miklós and Tamási, Árpád},
  title = {Using a RAG-enhanced large language model in a virtual teaching assistant role: Experiences from a pilot project in statistics education},
  journal = {Hungarian Statistical Review},
  year = {2024},
  volume = {7},
  number = {2},
  pages = {3--27},
  doi = {10.35618/hsr2024.02.en003}
}
Kostenlos starten →