Selective Late Materialization in Modern Analytical Databases
Proceedings of the VLDB Endowment · 2025-07 · 18 (11) · 4616-4628
DOI: 10.14778/3749646.3749717 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the VLDB Endowment, online erschienen am 04.09.2025. Verfasst von Yihao Liu und 4 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 50 Literaturangaben.
Abstract (Originalsprache)
Late Materialization (LM) is a critical technique applied in traditional column stores to speed up analytical queries. However, with modern analytical databases evolved to incorporate a vectorized columnar execution engine, LM's benefits in I/O reduction and fast columnar query processing have diminished. In this paper, we redefine the concept of Late Materialization in the context of modern analytical databases and propose Selective Late Materialization (SLM) to allow each attribute in a query to choose its own materialization point that yields the minimum cost. SLM expands the solution space of the traditional materialization problem from one unified hard-coded binary decision (i.e., early or late) for all attributes to per attribute per query decisions. By integrating SLM into DuckDB, we show that SLM consistently outperforms the baselines of Early Materialization and Late Materialization by 14.7% and 8.9%, respectively, on average using the Join Order Benchmark (JOB), with up to 76.7% latency reduction for individual queries. We observe similar results for the TPC-DS benchmark.
Zitieren
APA
Liu, Y., Tang, S., Hui, Y., Zhou, H., & Zhang, H. (2025). Selective Late Materialization in Modern Analytical Databases. Proceedings of the VLDB Endowment, 18(11), 4616-4628. https://doi.org/10.14778/3749646.3749717
Vancouver
Liu Y, Tang S, Hui Y, Zhou H, Zhang H. Selective Late Materialization in Modern Analytical Databases. Proceedings of the VLDB Endowment. 2025;18(11):4616-4628. doi:10.14778/3749646.3749717
BibTeX
@article{Liu2025,
author = {Liu, Yihao and Tang, Shaoxuan and Hui, Yulong and Zhou, Hangrui and Zhang, Huanchen},
title = {Selective Late Materialization in Modern Analytical Databases},
journal = {Proceedings of the VLDB Endowment},
year = {2025},
volume = {18},
number = {11},
pages = {4616--4628},
doi = {10.14778/3749646.3749717}
}
EUVIMED