EUVIMEDEUVIMED entdecken
Crossref

Workload-Aware Incremental Reclustering in Cloud Data Warehouses

Yipeng Liu, Renfei Zhou, Jiaqi Yan, Huanchen Zhang

Proceedings of the ACM on Management of Data · 18.05.2026 · 4 (3) · 1-27

DOI: 10.1145/3802127 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the ACM on Management of Data, online erschienen am 18.05.2026. Verfasst von Yipeng Liu und 3 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 54 Literaturangaben. Gefördert von: National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Modern cloud data warehouses store data in micro-partitions and rely on metadata (e.g., zonemaps) for efficient data pruning during query processing. Maintaining data clustering in a large-scale table is crucial for effective data pruning. Existing automatic clustering approaches lack the flexibility required in dynamic cloud environments with continuous data ingestion and evolving workloads. This paper advocates a clean separation between reclustering policy and clustering-key selection. We introduce the concept of boundary micro-partitions that sit on the boundary of query ranges. We then present WAIR, a workload-aware algorithm to identify and recluster only boundary micro-partitions most critical for pruning efficiency. WAIR achieves near-optimal (with respect to fully sorted table layouts) query performance but incurs significantly lower reclustering cost with a theoretical upper bound. We further implement the algorithm into a prototype reclustering service and evaluate on standard benchmarks (TPC-H, DSB) and a real-world workload. Results show that WAIR improves query performance and reduces the overall cost compared to existing solutions.

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Liu, Y., Zhou, R., Yan, J., & Zhang, H. (2026). Workload-Aware Incremental Reclustering in Cloud Data Warehouses. Proceedings of the ACM on Management of Data, 4(3), 1-27. https://doi.org/10.1145/3802127

Vancouver

Liu Y, Zhou R, Yan J, Zhang H. Workload-Aware Incremental Reclustering in Cloud Data Warehouses. Proceedings of the ACM on Management of Data. 2026;4(3):1-27. doi:10.1145/3802127

BibTeX
@article{Liu2026,
  author = {Liu, Yipeng and Zhou, Renfei and Yan, Jiaqi and Zhang, Huanchen},
  title = {Workload-Aware Incremental Reclustering in Cloud Data Warehouses},
  journal = {Proceedings of the ACM on Management of Data},
  year = {2026},
  volume = {4},
  number = {3},
  pages = {1--27},
  doi = {10.1145/3802127}
}
Kostenlos starten →