EUVIMEDEUVIMED entdecken
Crossref

Self Data Augmentation for Open Domain Question Answering

Qin Zhang, Mengqi Zheng, Shangsi Chen, Han Liu, Meng Fang

ACM Transactions on Information Systems · 31.03.2025 · 43 (2) · 1-35

DOI: 10.1145/3707449 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Information Systems, online erschienen am 28.01.2025. Verfasst von Qin Zhang und 4 weiteren Autor:innen. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 74 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Guangdong Provincial Natural Science Foundation, Shenzhen Science and Technology Program.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Information Retrieval (IR) constitutes a vital facet of Open Domain Question Answering (ODQA) systems, focusing on the exploration of pertinent information within extensive collections of passages, such as Wikipedia, to facilitate subsequent reader processing. Historically, IR relied on textual overlaps for relevant context retrieval, employing methods like BM25 and TF-IDF, which, however, lacked natural language understanding. The advent of deep learning ushered in a new era, leading to the introduction of Dense Passage Retrievers (DPR), shows superiority over traditional sparse retrievers. These dense retrievers leverage Pre-Trained Language Models (PLMs) to initialize context encoders, enabling the extraction of natural language representations. They utilize the distance between latent vectors of contexts as a metric for assessing similarity. However, DPR methods are heavily reliant on large volumes of meticulously labeled data, such as Natural Questions. The process of data labeling is both costly and time-intensive. In this article, we propose a novel data augmentation methodology Self Data Augmentation (SDA) that employs DPR models to automatically annotate unanswered questions. Specifically, we initiate the process by retrieving relevant pseudo passages for these unlabeled questions. We subsequently introduce three distinct passage selection methods to annotate these pseudo passages. Ultimately, we amalgamate the pseudo-labeled passages with the unanswered questions to create augmented data. Our experimental evaluations conducted on two extensive datasets (Natural Questions and TriviaQA), alongside a relatively small dataset (WebQuestions), utilizing three diverse base models, illustrate the significant enhancement achieved through the incorporation of freshly augmented data. Moreover, our proposed data augmentation method exhibits remarkable flexibility, which is readily adaptable to various dense retrievers. Additionally, we have conducted a comprehensive human study on the augmented data, which further supports our conclusions.

Förderung

  • National Natural Science Foundation of China
  • Guangdong Provincial Natural Science Foundation
  • Shenzhen Science and Technology Program

Zitieren

APA

Zhang, Q., Zheng, M., Chen, S., Liu, H., & Fang, M. (2025). Self Data Augmentation for Open Domain Question Answering. ACM Transactions on Information Systems, 43(2), 1-35. https://doi.org/10.1145/3707449

Vancouver

Zhang Q, Zheng M, Chen S, Liu H, Fang M. Self Data Augmentation for Open Domain Question Answering. ACM Transactions on Information Systems. 2025;43(2):1-35. doi:10.1145/3707449

BibTeX
@article{Zhang2025,
  author = {Zhang, Qin and Zheng, Mengqi and Chen, Shangsi and Liu, Han and Fang, Meng},
  title = {Self Data Augmentation for Open Domain Question Answering},
  journal = {ACM Transactions on Information Systems},
  year = {2025},
  volume = {43},
  number = {2},
  pages = {1--35},
  doi = {10.1145/3707449}
}
Kostenlos starten →