EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Enhancing Retrieval-Augmented Generation Accuracy with Dynamic Chunking and Optimized Vector Search

Derya Tanyildiz, Serkan Ayvaz, Mehmet Fatih Amasyali

Orclever Proceedings of Research and Development · 31.12.2024 · 5 (1) · 215-225

DOI: 10.56038/oprd.v5i1.516 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Orclever Proceedings of Research and Development, online erschienen am 31.12.2024. Verfasst von Derya Tanyildiz und 2 weiteren Autor:innen. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 14 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Retrieval-Augmented Generation (RAG) architectures depend on the integration of efficient retrieval and ranking mechanisms to enhance response accuracy and relevance. This study investigates a novel approach to improving the response performance of RAG systems, leveraging dynamic chunking for contextual coherence, Sentence-Transformers (all-mpnet-base-v2) for high-quality embeddings, and cross-encoder-based re-ranking for retrieval refinement. Our evaluation utilizes RAGAS metrics to assess key performance metrics, including faithfulness, relevancy, correctness, and context precision. Empirical evaluations highlighted the significant impact of index choice on the performance. Our proposed approach integrates the FAISS HNSW index with re-ranking, resulting in a balanced architecture that improves response fidelity without compromising efficiency. These insights underscore the importance of advanced indexing and retrieval techniques in bridging the gap between large-scale language models and domain-specific information needs. The findings provide a robust framework for future research in optimizing RAG systems, particularly in scenarios requiring high-context preservation and precision.

Zitieren

APA

Tanyildiz, D., Ayvaz, S., & Amasyali, M. F. (2024). Enhancing Retrieval-Augmented Generation Accuracy with Dynamic Chunking and Optimized Vector Search. Orclever Proceedings of Research and Development, 5(1), 215-225. https://doi.org/10.56038/oprd.v5i1.516

Vancouver

Tanyildiz D, Ayvaz S, Amasyali MF. Enhancing Retrieval-Augmented Generation Accuracy with Dynamic Chunking and Optimized Vector Search. Orclever Proceedings of Research and Development. 2024;5(1):215-225. doi:10.56038/oprd.v5i1.516

BibTeX
@article{Tanyildiz2024,
  author = {Tanyildiz, Derya and Ayvaz, Serkan and Amasyali, Mehmet Fatih},
  title = {Enhancing Retrieval-Augmented Generation Accuracy with Dynamic Chunking and Optimized Vector Search},
  journal = {Orclever Proceedings of Research and Development},
  year = {2024},
  volume = {5},
  number = {1},
  pages = {215--225},
  doi = {10.56038/oprd.v5i1.516}
}
Kostenlos starten →