EUVIMEDObjevte EUVIMED
Crossref

ROGER: Ranking-Oriented Generative Retrieval

Yujia Zhou, Jing Yao, Zhicheng Dou, Yiteng Tu, Ledell Wu, Tat-Seng Chua, Ji-Rong Wen

ACM Transactions on Information Systems · 2024-11-30 · 42 (6) · 1-25

DOI: 10.1145/3603167 ↗

At a glance

Journal article in ACM Transactions on Information Systems, published online on 2024-10-22. Written by Yujia Zhou and 6 co-authors. Cited 9 times so far (Crossref); 60 references. Funded by: National Natural Science Foundation of China, Engineering Research Center of Next-Generation Intelligent Search and Recommendation, MOE, Beijing Key Laboratory of Big Data Management and Analysis Methods.

AbstraktBibliografické údajeCiteRelated studies

Abstract (original language)

In recent years, various dense retrieval methods have been developed to improve the performance of search engines with a vectorized index. However, these approaches require a large pre-computed index and have a limited capacity to memorize all semantics in a document within a single vector. To address these issues, researchers have explored end-to-end generative retrieval models that use a seq-to-seq generative model to directly return identifiers of relevant documents. Although these models have been effective, they are often trained with the MLE method. It only encourages the model to assign a high probability to the relevant document identifier, ignoring the relevance comparisons of other documents. This may lead to performance degradation in ranking tasks, where the core is to compare the relevance between documents. To address this issue, we propose a ranking-oriented generative retrieval model that incorporates relevance signals to better estimate the relative relevance of different documents in ranking tasks. Based upon the analysis of the optimization objectives of dense retrieval and generative retrieval, we propose utilizing dense retrieval to provide relevance feedback for generative retrieval. Under an alternate training framework, the generative retrieval model gradually acquires higher-quality ranking signals to optimize the model. Experimental results show that our approach increasing Recall@1 by 12.9% with respect to the baselines on MS MARCO dataset.

Funding

  • National Natural Science Foundation of China
  • Engineering Research Center of Next-Generation Intelligent Search and Recommendation, MOE
  • Beijing Key Laboratory of Big Data Management and Analysis Methods

Cite

APA

Zhou, Y., Yao, J., Dou, Z., Tu, Y., Wu, L., Chua, T., & Wen, J. (2024). ROGER: Ranking-Oriented Generative Retrieval. ACM Transactions on Information Systems, 42(6), 1-25. https://doi.org/10.1145/3603167

Vancouver

Zhou Y, Yao J, Dou Z, Tu Y, Wu L, Chua T, et al. ROGER: Ranking-Oriented Generative Retrieval. ACM Transactions on Information Systems. 2024;42(6):1-25. doi:10.1145/3603167

BibTeX
@article{Zhou2024,
  author = {Zhou, Yujia and Yao, Jing and Dou, Zhicheng and Tu, Yiteng and Wu, Ledell and Chua, Tat-Seng and Wen, Ji-Rong},
  title = {ROGER: Ranking-Oriented Generative Retrieval},
  journal = {ACM Transactions on Information Systems},
  year = {2024},
  volume = {42},
  number = {6},
  pages = {1--25},
  doi = {10.1145/3603167}
}
Start for free →