Pre-training Methods in Information Retrieval
Foundations and Trends® in Information Retrieval · 18.08.2022 · 16 (3) · 178-317
DOI: 10.1561/1500000100 ↗Kurz gefasst
Fachartikel in der Zeitschrift Foundations and Trends® in Information Retrieval, online erschienen am 18.08.2022. Verfasst von Yixing Fan und 7 weiteren Autor:innen. Die Arbeit wurde bisher 47-mal zitiert (Crossref) und nennt 323 Literaturangaben.
Abstract (Originalsprache)
The core of information retrieval (IR) is to identify relevant information from large-scale resources and return it as a ranked list to respond to user’s information need. In recent years, the resurgence of deep learning has greatly advanced this field and leads to a hot topic named NeuIR (i.e., neural information retrieval), especially the paradigm of pre-training methods (PTMs). Owing to sophisticated pre-training objectives and huge model size, pre-trained models can learn universal language representations from massive textual data, which are beneficial to the ranking task of IR. Recently, a large number of works, which are dedicated to the application of PTMs in IR, have been introduced to promote the retrieval performance. Considering the rapid progress of this direction, this survey aims to provide a systematic review of pre-training methods in IR. To be specific, we present an overview of PTMs applied in different components of an IR system, including the retrieval component, the re-ranking component, and other components. In addition, we also introduce PTMs specifically designed for IR, and summarize available datasets as well as benchmark leaderboards. Moreover, we discuss some open challenges and highlight several promising directions, with the hope of inspiring and facilitating more works on these topics for future research.
Zitieren
APA
Fan, Y., Xie, X., Cai, Y., Chen, J., Ma, X., Li, X., Zhang, R., & Guo, J. (2022). Pre-training Methods in Information Retrieval. Foundations and Trends® in Information Retrieval, 16(3), 178-317. https://doi.org/10.1561/1500000100
Vancouver
Fan Y, Xie X, Cai Y, Chen J, Ma X, Li X, et al. Pre-training Methods in Information Retrieval. Foundations and Trends® in Information Retrieval. 2022;16(3):178-317. doi:10.1561/1500000100
BibTeX
@article{Fan2022,
author = {Fan, Yixing and Xie, Xiaohui and Cai, Yinqiong and Chen, Jia and Ma, Xinyu and Li, Xiangsheng and Zhang, Ruqing and Guo, Jiafeng},
title = {Pre-training Methods in Information Retrieval},
journal = {Foundations and Trends® in Information Retrieval},
year = {2022},
volume = {16},
number = {3},
pages = {178--317},
doi = {10.1561/1500000100}
}
EUVIMED