EUVIMEDEUVIMED entdecken
Crossref

Data Imputation with Limited Data Redundancy Using Data Lakes

Chenyu Yang, Yuyu Luo, Chuanxuan Cui, Ju Fan, Chengliang Chai, Nan Tang

Proceedings of the VLDB Endowment · 2025-06 · 18 (10) · 3354-3367

DOI: 10.14778/3748191.3748200 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the VLDB Endowment, online erschienen am 04.09.2025. Verfasst von Chenyu Yang und 5 weiteren Autor:innen. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 87 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Data imputation is essential for many data science applications. Existing methods rely heavily on sufficient data redundancy from within-table values. However, many real-world datasets often lack such data redundancy, necessitating external data sources. In this paper, we introduce a retrieval-augmented imputation framework, LakeFill , which combines large language models (LLMs) and data lakes to address this challenge. Unlike existing "table-level" retrieval methods designed for question answering, which retrieve data in the granularity of tables, LakeFill performs fine-grained "tuple-level" retrieval, optimized specifically for data imputation at the tuple level. It encodes (possibly incomplete) tuples to capture nuanced similarities and differences, enabling effective identification of candidate tuples. A novel reranking method that integrates checklist-based training data annotation with stratified training group construction further refines the retrieved tuples. Finally, a reasoner with a novel two-stage confidence-aware imputation ensures reliable imputation results. Extensive experiments show that LakeFill significantly outperforms state-of-the-art methods for data imputation when there is limited data redundancy.

Zitieren

APA

Yang, C., Luo, Y., Cui, C., Fan, J., Chai, C., & Tang, N. (2025). Data Imputation with Limited Data Redundancy Using Data Lakes. Proceedings of the VLDB Endowment, 18(10), 3354-3367. https://doi.org/10.14778/3748191.3748200

Vancouver

Yang C, Luo Y, Cui C, Fan J, Chai C, Tang N. Data Imputation with Limited Data Redundancy Using Data Lakes. Proceedings of the VLDB Endowment. 2025;18(10):3354-3367. doi:10.14778/3748191.3748200

BibTeX
@article{Yang2025,
  author = {Yang, Chenyu and Luo, Yuyu and Cui, Chuanxuan and Fan, Ju and Chai, Chengliang and Tang, Nan},
  title = {Data Imputation with Limited Data Redundancy Using Data Lakes},
  journal = {Proceedings of the VLDB Endowment},
  year = {2025},
  volume = {18},
  number = {10},
  pages = {3354--3367},
  doi = {10.14778/3748191.3748200}
}
Kostenlos starten →