EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Web Application for Retrieval-Augmented Generation: Implementation and Testing

Irina Radeva, Ivan Popchev, Lyubka Doukovska, Miroslava Dimitrova

Electronics · 04.04.2024 · 13 (7) · 1361

DOI: 10.3390/electronics13071361 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Electronics, online erschienen am 04.04.2024. Verfasst von Irina Radeva und 3 weiteren Autor:innen. Die Arbeit wurde bisher 32-mal zitiert (Crossref) und nennt 47 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Bulgarian Ministry of Education and Science.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The purpose of this paper is to explore the implementation of retrieval-augmented generation (RAG) technology with open-source large language models (LLMs). A dedicated web-based application, PaSSER, was developed, integrating RAG with Mistral:7b, Llama2:7b, and Orca2:7b models. Various software instruments were used in the application’s development. PaSSER employs a set of evaluation metrics, including METEOR, ROUGE, BLEU, perplexity, cosine similarity, Pearson correlation, and F1 score, to assess LLMs’ performance, particularly within the smart agriculture domain. The paper presents the results and analyses of two tests. One test assessed the performance of LLMs across different hardware configurations, while the other determined which model delivered the most accurate and contextually relevant responses within RAG. The paper discusses the integration of blockchain with LLMs to manage and store assessment results within a blockchain environment. The tests revealed that GPUs are essential for fast text generation, even for 7b models. Orca2:7b on Mac M1 was the fastest, and Mistral:7b had superior performance on the 446 question–answer dataset. The discussion is on technical and hardware considerations affecting LLMs’ performance. The conclusion outlines future developments in leveraging other LLMs, fine-tuning approaches, and further integration with blockchain and IPFS.

Förderung

  • Bulgarian Ministry of Education and Science

Zitieren

APA

Radeva, I., Popchev, I., Doukovska, L., & Dimitrova, M. (2024). Web Application for Retrieval-Augmented Generation: Implementation and Testing. Electronics, 13(7), 1361. https://doi.org/10.3390/electronics13071361

Vancouver

Radeva I, Popchev I, Doukovska L, Dimitrova M. Web Application for Retrieval-Augmented Generation: Implementation and Testing. Electronics. 2024;13(7):1361. doi:10.3390/electronics13071361

BibTeX
@article{Radeva2024,
  author = {Radeva, Irina and Popchev, Ivan and Doukovska, Lyubka and Dimitrova, Miroslava},
  title = {Web Application for Retrieval-Augmented Generation: Implementation and Testing},
  journal = {Electronics},
  year = {2024},
  volume = {13},
  number = {7},
  pages = {1361},
  doi = {10.3390/electronics13071361}
}
Kostenlos starten →