EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Enabling Retriever-LLM Connection across the Semantic Gap in Retrieval-Augmented Generation

Fuda Ye, Shuangyin Li, Yongqi Zhang, Lei Chen, Shaobing Qu

ACM Transactions on Knowledge Discovery from Data · 30.11.2026 · 20 (9) · 1-39

DOI: 10.1145/3847108 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Knowledge Discovery from Data, online erschienen am 05.11.2026. Verfasst von Fuda Ye und 4 weiteren Autor:innen. Die Arbeit nennt 131 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Retrieval-augmented generation (RAG) has attracted significant attention for enhancing large language models (LLMs) in domain-specific and knowledge-intensive tasks by utilizing external documents retrieved by retrievers. However, LLMs often struggle to determine which retrieved documents are relevant and how they relate to one another. We argue that this difficulty arises from a semantic gap between retrievers and LLMs due to differences in their training objectives and architectures. Existing methods either align retrievers and LLMs through costly fine-tuning or feedback signals, but they still do not explicitly strengthen document relationship modeling during generation. This article proposes ConRAG, a novel enhanced RAG framework to establish an information connection between retrievers and LLMs in RAG, thereby enhancing relationship modeling of LLMs. Specifically, ConRAG employs a lightweight Con-Former model, placed between a retriever and an LLM, to capture and transmit semantic information. Then, a semantics injection strategy is employed to integrate the semantic information into the LLM’s generation. Accordingly, we employ three tasks for feature modeling and alignment: two relationship modeling tasks to consolidate the local and global perceptions of document relevance and one generative alignment task to facilitate the interpretation by the LLM. Notably, ConRAG is suitable for low-resource scenarios where LLMs and retrievers are frozen. Further analysis shows that retriever-derived information helps the LLM better identify relevant evidence and model relationships among documents, leading to more effective generation. The source code is available at https://github.com/yefd/ConRAG .

Zitieren

APA

Ye, F., Li, S., Zhang, Y., Chen, L., & Qu, S. (2026). Enabling Retriever-LLM Connection across the Semantic Gap in Retrieval-Augmented Generation. ACM Transactions on Knowledge Discovery from Data, 20(9), 1-39. https://doi.org/10.1145/3847108

Vancouver

Ye F, Li S, Zhang Y, Chen L, Qu S. Enabling Retriever-LLM Connection across the Semantic Gap in Retrieval-Augmented Generation. ACM Transactions on Knowledge Discovery from Data. 2026;20(9):1-39. doi:10.1145/3847108

BibTeX
@article{Ye2026,
  author = {Ye, Fuda and Li, Shuangyin and Zhang, Yongqi and Chen, Lei and Qu, Shaobing},
  title = {Enabling Retriever-LLM Connection across the Semantic Gap in Retrieval-Augmented Generation},
  journal = {ACM Transactions on Knowledge Discovery from Data},
  year = {2026},
  volume = {20},
  number = {9},
  pages = {1--39},
  doi = {10.1145/3847108}
}
Kostenlos starten →