Workload-Aware Incremental Reclustering in Cloud Data Warehouses
Proceedings of the ACM on Management of Data · 18.05.2026 · 4 (3) · 1-27
DOI: 10.1145/3802127 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the ACM on Management of Data, online erschienen am 18.05.2026. Verfasst von Yipeng Liu und 3 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 54 Literaturangaben. Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
Modern cloud data warehouses store data in micro-partitions and rely on metadata (e.g., zonemaps) for efficient data pruning during query processing. Maintaining data clustering in a large-scale table is crucial for effective data pruning. Existing automatic clustering approaches lack the flexibility required in dynamic cloud environments with continuous data ingestion and evolving workloads. This paper advocates a clean separation between reclustering policy and clustering-key selection. We introduce the concept of boundary micro-partitions that sit on the boundary of query ranges. We then present WAIR, a workload-aware algorithm to identify and recluster only boundary micro-partitions most critical for pruning efficiency. WAIR achieves near-optimal (with respect to fully sorted table layouts) query performance but incurs significantly lower reclustering cost with a theoretical upper bound. We further implement the algorithm into a prototype reclustering service and evaluate on standard benchmarks (TPC-H, DSB) and a real-world workload. Results show that WAIR improves query performance and reduces the overall cost compared to existing solutions.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Liu, Y., Zhou, R., Yan, J., & Zhang, H. (2026). Workload-Aware Incremental Reclustering in Cloud Data Warehouses. Proceedings of the ACM on Management of Data, 4(3), 1-27. https://doi.org/10.1145/3802127
Vancouver
Liu Y, Zhou R, Yan J, Zhang H. Workload-Aware Incremental Reclustering in Cloud Data Warehouses. Proceedings of the ACM on Management of Data. 2026;4(3):1-27. doi:10.1145/3802127
BibTeX
@article{Liu2026,
author = {Liu, Yipeng and Zhou, Renfei and Yan, Jiaqi and Zhang, Huanchen},
title = {Workload-Aware Incremental Reclustering in Cloud Data Warehouses},
journal = {Proceedings of the ACM on Management of Data},
year = {2026},
volume = {4},
number = {3},
pages = {1--27},
doi = {10.1145/3802127}
}
EUVIMED