EUVIMEDEUVIMED entdecken
Crossref

Information Retrieval Using Large Language Models on a Restricted Access Environment

Diego Costa, Gabriel Matos, Gilson Russo, Leon Barroso, Erick Bezerra

International Journal on Natural Language Computing · 28.04.2026 · 15 (2) · 21-35

DOI: 10.5121/ijnlc.2026.15202 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal on Natural Language Computing, online erschienen am 28.04.2026. Verfasst von Diego Costa und 4 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Information retrieval plays an important role in everyday tasks, especially when it comes to documentation. Retrieving information about private documentation used to build other software is very challenging due to its absence on the internet, meaning there is no information about it beyond its own documentation. Due to concerns about confidential data, using external proprietary systems is prohibited. Motivated by this, in this study, we present Mycroft, a retrieval system that leverages the Retrieval Augmented Generation technique to find a feasible approach that improves search and information retrieval requested by users about the documentation. To implement this system, a dataset of questions and answers about the documentation was generated for evaluation. The system was developed on-premise using open-source Large Language Models and evaluated using Natural Language Processing metrics and human evaluation to validate the generated answers. Following an extensive evaluation of the results, the proposed retrieval system demonstrated satisfactory performance in addressing user queries and achieved favorable outcomes in human evaluation, indicating its utility.

Zitieren

APA

Costa, D., Matos, G., Russo, G., Barroso, L., & Bezerra, E. (2026). Information Retrieval Using Large Language Models on a Restricted Access Environment. International Journal on Natural Language Computing, 15(2), 21-35. https://doi.org/10.5121/ijnlc.2026.15202

Vancouver

Costa D, Matos G, Russo G, Barroso L, Bezerra E. Information Retrieval Using Large Language Models on a Restricted Access Environment. International Journal on Natural Language Computing. 2026;15(2):21-35. doi:10.5121/ijnlc.2026.15202

BibTeX
@article{Costa2026,
  author = {Costa, Diego and Matos, Gabriel and Russo, Gilson and Barroso, Leon and Bezerra, Erick},
  title = {Information Retrieval Using Large Language Models on a Restricted Access Environment},
  journal = {International Journal on Natural Language Computing},
  year = {2026},
  volume = {15},
  number = {2},
  pages = {21--35},
  doi = {10.5121/ijnlc.2026.15202}
}
Kostenlos starten →