A multi-agent rag architecture for university information management: A comprehensive analysis of performance, reliability, and cost
Serbian Journal of Electrical Engineering · 2026 · 23 (2) · 227-256
DOI: 10.2298/sjee2602227b ↗Kurz gefasst
Fachartikel in der Zeitschrift Serbian Journal of Electrical Engineering, 2026. Verfasst von Turgay Bilgin und 2 weiteren Autor:innen. Die Arbeit nennt 18 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).
Abstract (Originalsprache)
University regulations and announcements at Bursa Technical University (BTU) are dispersed across PDF files, web pages, and notice boards, causing information retrieval inefficiencies for students and administrative staff. This study presents the development and quantitative evaluation of BTU-Chatbot, an Agentic Retrieval-Augmented Generation (RAG) powered conversational assistant that consolidates fragmented institutional information into a single citation-aware dialogue interface. Ninety-seven PDF documents were processed using PyPDFLoader and regular-expression-based preprocessing, then embedded into 1536-dimensional vectors using OpenAI’s text-embedding-ada-v2 model and stored in a 29 MB ChromaDB collection. The vector-based retrieval layer selects the three most relevant passages per query using cosine similarity search. The upper layer implements a LangChain-orchestrated multi-agent ReAct loop, in which the retrieve tool accesses the vector database while the Google_search_univ tool performs domain-restricted searches limited to the “*.btu.edu.tr” domain. GPT-4o-mini, with a 128k context window, serves as the generative backbone. System reliability was measured using the RAGAS metric suite. The best performing run achieved Context Recall = 0.97, Context Precision = 0.99, and F1- RP (the F1 score of Context Recall and Precision) = 0.954, demonstrating nearperfect retrieval accuracy. The average cost per query was 6.6×10⁻⁵ USD, with 7.6 s of latency for typical 124-token exchanges. BTU-Chatbot demonstrates that an Agentic RAG pipeline can deliver source-grounded, citation-attributed answers to university-specific queries at low operating cost, although further improvements in generation faithfulness are needed before full deployment.
Zitieren
APA
Bilgin, T., Gül, Y., & Akgün, Y. (2026). A multi-agent rag architecture for university information management: A comprehensive analysis of performance, reliability, and cost. Serbian Journal of Electrical Engineering, 23(2), 227-256. https://doi.org/10.2298/sjee2602227b
Vancouver
Bilgin T, Gül Y, Akgün Y. A multi-agent rag architecture for university information management: A comprehensive analysis of performance, reliability, and cost. Serbian Journal of Electrical Engineering. 2026;23(2):227-256. doi:10.2298/sjee2602227b
BibTeX
@article{Bilgin2026,
author = {Bilgin, Turgay and Gül, Yusuf and Akgün, Yücel},
title = {A multi-agent rag architecture for university information management: A comprehensive analysis of performance, reliability, and cost},
journal = {Serbian Journal of Electrical Engineering},
year = {2026},
volume = {23},
number = {2},
pages = {227--256},
doi = {10.2298/sjee2602227b}
}
EUVIMED