EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

A multi-agent rag architecture for university information management: A comprehensive analysis of performance, reliability, and cost

Turgay Bilgin, Yusuf Gül, Yücel Akgün

Serbian Journal of Electrical Engineering · 2026 · 23 (2) · 227-256

DOI: 10.2298/sjee2602227b ↗

Kurz gefasst

Fachartikel in der Zeitschrift Serbian Journal of Electrical Engineering, 2026. Verfasst von Turgay Bilgin und 2 weiteren Autor:innen. Die Arbeit nennt 18 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

University regulations and announcements at Bursa Technical University (BTU) are dispersed across PDF files, web pages, and notice boards, causing information retrieval inefficiencies for students and administrative staff. This study presents the development and quantitative evaluation of BTU-Chatbot, an Agentic Retrieval-Augmented Generation (RAG) powered conversational assistant that consolidates fragmented institutional information into a single citation-aware dialogue interface. Ninety-seven PDF documents were processed using PyPDFLoader and regular-expression-based preprocessing, then embedded into 1536-dimensional vectors using OpenAI’s text-embedding-ada-v2 model and stored in a 29 MB ChromaDB collection. The vector-based retrieval layer selects the three most relevant passages per query using cosine similarity search. The upper layer implements a LangChain-orchestrated multi-agent ReAct loop, in which the retrieve tool accesses the vector database while the Google_search_univ tool performs domain-restricted searches limited to the “*.btu.edu.tr” domain. GPT-4o-mini, with a 128k context window, serves as the generative backbone. System reliability was measured using the RAGAS metric suite. The best performing run achieved Context Recall = 0.97, Context Precision = 0.99, and F1- RP (the F1 score of Context Recall and Precision) = 0.954, demonstrating nearperfect retrieval accuracy. The average cost per query was 6.6×10⁻⁵ USD, with 7.6 s of latency for typical 124-token exchanges. BTU-Chatbot demonstrates that an Agentic RAG pipeline can deliver source-grounded, citation-attributed answers to university-specific queries at low operating cost, although further improvements in generation faithfulness are needed before full deployment.

Zitieren

APA

Bilgin, T., Gül, Y., & Akgün, Y. (2026). A multi-agent rag architecture for university information management: A comprehensive analysis of performance, reliability, and cost. Serbian Journal of Electrical Engineering, 23(2), 227-256. https://doi.org/10.2298/sjee2602227b

Vancouver

Bilgin T, Gül Y, Akgün Y. A multi-agent rag architecture for university information management: A comprehensive analysis of performance, reliability, and cost. Serbian Journal of Electrical Engineering. 2026;23(2):227-256. doi:10.2298/sjee2602227b

BibTeX
@article{Bilgin2026,
  author = {Bilgin, Turgay and Gül, Yusuf and Akgün, Yücel},
  title = {A multi-agent rag architecture for university information management: A comprehensive analysis of performance, reliability, and cost},
  journal = {Serbian Journal of Electrical Engineering},
  year = {2026},
  volume = {23},
  number = {2},
  pages = {227--256},
  doi = {10.2298/sjee2602227b}
}
Kostenlos starten →