A Comparative Performance Analysis of Locally Deployed Large Language Models Through a Retrieval-Augmented Generation Educational Assistant Application for Textual Data Extraction
AI · 06.06.2025 · 6 (6) · 119
DOI: 10.3390/ai6060119 ↗Kurz gefasst
Fachartikel in der Zeitschrift AI, online erschienen am 06.06.2025. Verfasst von Amitabh Mishra und 1 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 50 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Background
Rapid advancements in large language models (LLMs) have significantly enhanced Retrieval-Augmented Generation (RAG) techniques, leading to more accurate and context-aware information retrieval systems.
Methods
This article presents the creation of a RAG-based chatbot tailored for university course catalogs, aimed at answering queries related to course details and other essential academic information, and investigates its performance by testing it on several locally deployed large language models. By leveraging multiple LLM architectures, we evaluate performance of the models under test in terms of context length, embedding size, computational efficiency, and relevance of responses.
Results
The experimental analysis obtained by this research, which builds on recent comparative studies, reveals that while larger models achieve higher relevance scores, they incur greater response times than smaller, more efficient models.
Conclusions
The findings underscore the importance of balancing accuracy and efficiency for real-time educational applications. Overall, this work contributes to the field by offering insights into optimal RAG configurations and practical guidelines for deploying AI-powered educational assistants.
Zitieren
APA
Mishra, A., & Brahmanapally, N. (2025). A Comparative Performance Analysis of Locally Deployed Large Language Models Through a Retrieval-Augmented Generation Educational Assistant Application for Textual Data Extraction. AI, 6(6), 119. https://doi.org/10.3390/ai6060119
Vancouver
Mishra A, Brahmanapally N. A Comparative Performance Analysis of Locally Deployed Large Language Models Through a Retrieval-Augmented Generation Educational Assistant Application for Textual Data Extraction. AI. 2025;6(6):119. doi:10.3390/ai6060119
BibTeX
@article{Mishra2025,
author = {Mishra, Amitabh and Brahmanapally, Nagaraju},
title = {A Comparative Performance Analysis of Locally Deployed Large Language Models Through a Retrieval-Augmented Generation Educational Assistant Application for Textual Data Extraction},
journal = {AI},
year = {2025},
volume = {6},
number = {6},
pages = {119},
doi = {10.3390/ai6060119}
}
EUVIMED