EUVIMEDEUVIMED entdecken
Crossref

Inference Scaling Law for Retrieval Augmented Generation

Shu Zhou, Yuxuan Ao, Yunyang Xuan, Xin Wang, Tao Fan, Hao Wang

Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (19) · 16522-16530

DOI: 10.1609/aaai.v40i19.38692 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Shu Zhou und 5 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Retrieval-augmented generation (RAG) has recently emerged as a powerful framework for knowledge-intensive natural language processing tasks, which leverages the strengths of both pre-trained language models and external knowledge. While significant progress has been made, the scaling behavior of these approaches during inference remains poorly understood. Towards this end, this paper presents a comprehensive study of inference scaling law for RAG models, which investigates how inference performance scales with respect to key factors including retriever model scale, generator model scale, number of retrieved documents, and context window size. Through extensive experiments on benchmark datasets, we establish empirical scaling laws that reveal power-law and sigmoid-type relationships between these factors and performance. We further build a joint inference scaling law with theoretical justification. With the proposed scaling laws, we can understand the performance tendency of RAG models under different computational resources. We believe our insights can pave the way for efficient and effective deployment of RAG models in more applications.

Zitieren

APA

Zhou, S., Ao, Y., Xuan, Y., Wang, X., Fan, T., & Wang, H. (2026). Inference Scaling Law for Retrieval Augmented Generation. Proceedings of the AAAI Conference on Artificial Intelligence, 40(19), 16522-16530. https://doi.org/10.1609/aaai.v40i19.38692

Vancouver

Zhou S, Ao Y, Xuan Y, Wang X, Fan T, Wang H. Inference Scaling Law for Retrieval Augmented Generation. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(19):16522-16530. doi:10.1609/aaai.v40i19.38692

BibTeX
@article{Zhou2026,
  author = {Zhou, Shu and Ao, Yuxuan and Xuan, Yunyang and Wang, Xin and Fan, Tao and Wang, Hao},
  title = {Inference Scaling Law for Retrieval Augmented Generation},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2026},
  volume = {40},
  number = {19},
  pages = {16522--16530},
  doi = {10.1609/aaai.v40i19.38692}
}
Kostenlos starten →