IncreQueryFusion: On-demand Data Fusion Framework in Dynamic Data Lakes
Proceedings of the VLDB Endowment · 01.05.2026 · 19 (9) · 2032-2044
DOI: 10.14778/3819518.3819532 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the VLDB Endowment, online erschienen am 19.08.2026. Verfasst von Wenhao Liu und 6 weiteren Autor:innen. Die Arbeit nennt 47 Literaturangaben.
Abstract (Originalsprache)
In data lakes, efficient data fusion is essential yet challenging in dynamic scenarios due to heterogeneous multi-source data. Batch-based methods ensure high accuracy but suffer from high latency, while emerging on-demand fusion approaches, despite offering real-time responsiveness, lack native support for incremental scenarios and often struggle with query evidence constraints. To overcome these issues, we propose IncreQueryFusion, an end-to-end on-demand fusion framework tailored for dynamic data lakes. First, it introduces a Temporal Index Evidence Retrieval module to incrementally retrieve and selectively expand evidence for subsequent fusion. Then, an adaptive aligned hierarchical fusion mechanism organizes data values and performs evidence-aware truth inference. Finally, a dynamic fusion truth maintenance algorithm refreshes fusion results efficiently without full recomputation. A comprehensive evaluation of established benchmarks and our newly constructed dynamic datasets demonstrates the effectiveness of IncreQueryFusion. It outperforms the state-of-the-art baseline in accuracy by 5%-30% on static workloads, while achieving speedups of over 10× against on-demand methods and over 100× against batch methods in dynamic scenarios.
Zitieren
APA
Liu, W., Wu, S., Tang, X., Zhang, Y., Peng, D., Huang, G., & Chen, G. (2026). IncreQueryFusion: On-demand Data Fusion Framework in Dynamic Data Lakes. Proceedings of the VLDB Endowment, 19(9), 2032-2044. https://doi.org/10.14778/3819518.3819532
Vancouver
Liu W, Wu S, Tang X, Zhang Y, Peng D, Huang G, et al. IncreQueryFusion: On-demand Data Fusion Framework in Dynamic Data Lakes. Proceedings of the VLDB Endowment. 2026;19(9):2032-2044. doi:10.14778/3819518.3819532
BibTeX
@article{Liu2026,
author = {Liu, Wenhao and Wu, Sai and Tang, Xiu and Zhang, Yitong and Peng, Dong and Huang, Guolong and Chen, Gang},
title = {IncreQueryFusion: On-demand Data Fusion Framework in Dynamic Data Lakes},
journal = {Proceedings of the VLDB Endowment},
year = {2026},
volume = {19},
number = {9},
pages = {2032--2044},
doi = {10.14778/3819518.3819532}
}
EUVIMED