Data Imputation with Limited Data Redundancy Using Data Lakes
Proceedings of the VLDB Endowment · 2025-06 · 18 (10) · 3354-3367
DOI: 10.14778/3748191.3748200 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the VLDB Endowment, online erschienen am 04.09.2025. Verfasst von Chenyu Yang und 5 weiteren Autor:innen. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 87 Literaturangaben.
Abstract (Originalsprache)
Data imputation is essential for many data science applications. Existing methods rely heavily on sufficient data redundancy from within-table values. However, many real-world datasets often lack such data redundancy, necessitating external data sources. In this paper, we introduce a retrieval-augmented imputation framework, LakeFill , which combines large language models (LLMs) and data lakes to address this challenge. Unlike existing "table-level" retrieval methods designed for question answering, which retrieve data in the granularity of tables, LakeFill performs fine-grained "tuple-level" retrieval, optimized specifically for data imputation at the tuple level. It encodes (possibly incomplete) tuples to capture nuanced similarities and differences, enabling effective identification of candidate tuples. A novel reranking method that integrates checklist-based training data annotation with stratified training group construction further refines the retrieved tuples. Finally, a reasoner with a novel two-stage confidence-aware imputation ensures reliable imputation results. Extensive experiments show that LakeFill significantly outperforms state-of-the-art methods for data imputation when there is limited data redundancy.
Zitieren
APA
Yang, C., Luo, Y., Cui, C., Fan, J., Chai, C., & Tang, N. (2025). Data Imputation with Limited Data Redundancy Using Data Lakes. Proceedings of the VLDB Endowment, 18(10), 3354-3367. https://doi.org/10.14778/3748191.3748200
Vancouver
Yang C, Luo Y, Cui C, Fan J, Chai C, Tang N. Data Imputation with Limited Data Redundancy Using Data Lakes. Proceedings of the VLDB Endowment. 2025;18(10):3354-3367. doi:10.14778/3748191.3748200
BibTeX
@article{Yang2025,
author = {Yang, Chenyu and Luo, Yuyu and Cui, Chuanxuan and Fan, Ju and Chai, Chengliang and Tang, Nan},
title = {Data Imputation with Limited Data Redundancy Using Data Lakes},
journal = {Proceedings of the VLDB Endowment},
year = {2025},
volume = {18},
number = {10},
pages = {3354--3367},
doi = {10.14778/3748191.3748200}
}
EUVIMED