Intelligent Retrieval-Augmented Generation Based Chatbot
International Journal of Creative and Open Research in Engineering and Management · 28.04.2026 · 02 (04) · 1-5
DOI: 10.55041/ijcope.v2i4.848 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Creative and Open Research in Engineering and Management, online erschienen am 28.04.2026. Verfasst von Atharva Karandikar Atharva Karandikar und 4 weiteren Autor:innen.
Abstract (Originalsprache)
We present a retrieval-augmented chatbot that combines dense retrieval with large language models (LLMs) to answer user queries grounded in external documents [1][2]. Our system ingests domain-specific documents into a vector database and uses an encoder to embed text chunks. For each query, the chatbot performs semantic search to retrieve the top-K relevant passages [3]. These passages are optionally re-ranked by a neural cross-encoder to boost precision [4][5]. The top-ranked chunks are prepended to the user’s query as context, and an LLM generates the final answer. To improve efficiency, we implement caching of retrieval results and answers, and include a fallback snippet-generation mode if the LLM fails. We implement the server in Python using FastAPI and open-source libraries (embedding and vector DB) along with custom code for caching and thread-safe operations. In evaluation, reranking yields significant gains in answer correctness (over 15 percentage points in one study) [5], and the entire pipeline achieves high-quality, faithful answers while remaining efficient. Our contributions include a detailed system design with component and sequence diagrams, implementation techniques (vector store, retriever, re- ranker, LLM), and an evaluation demonstrating the benefits of re-ranking and caching. Keywords—Retrieval-Augmented Generation, Chatbot, Information Retrieval, Vector Embeddings, Re-ranking, Large Language Models.
Zitieren
APA
Karandikar, A. K. A., Damke, S. D. S., Nakade, C. N. C., Joshi, H. J. H., & Lad, K. L. K. (2026). Intelligent Retrieval-Augmented Generation Based Chatbot. International Journal of Creative and Open Research in Engineering and Management, 02(04), 1-5. https://doi.org/10.55041/ijcope.v2i4.848
Vancouver
Karandikar AKA, Damke SDS, Nakade CNC, Joshi HJH, Lad KLK. Intelligent Retrieval-Augmented Generation Based Chatbot. International Journal of Creative and Open Research in Engineering and Management. 2026;02(04):1-5. doi:10.55041/ijcope.v2i4.848
BibTeX
@article{Karandikar2026,
author = {Karandikar, Atharva Karandikar Atharva and Damke, Sahil Damke Sahil and Nakade, Chidanand Nakade Chidanand and Joshi, Himaj Joshi Himaj and Lad, Kshitij Lad Kshitij},
title = {Intelligent Retrieval-Augmented Generation Based Chatbot},
journal = {International Journal of Creative and Open Research in Engineering and Management},
year = {2026},
volume = {02},
number = {04},
pages = {1--5},
doi = {10.55041/ijcope.v2i4.848}
}
EUVIMED