Vodka: Rethink Benchmarking Philosophy in HTAP Systems
Proceedings of the VLDB Endowment · 01.11.2025 · 19 (3) · 481-494
DOI: 10.14778/3778092.3778107 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the VLDB Endowment, online erschienen am 18.03.2026. Verfasst von Zirui Hu und 8 weiteren Autor:innen. Die Arbeit nennt 80 Literaturangaben.
Abstract (Originalsprache)
For real-time analysis of up-to-date data, hybrid transaction/analytical processing (HTAP) systems have been extensively studied. In general, three techniques play a critical role in HTAP systems, which are resource isolation, consistency model, and data sharing. However, there still lacks a benchmark suite that could comprehensively cover the three techniques. The core challenges come from the requirements of: (a) consistent workload resource consumption (provide workloads with the same computational complexity); (b) query-oriented freshness evaluation (focus on the degree of version staleness in the range of queried data); (c) precise data sharing efficiency measurement (catch the synchronization status accurately). In this paper, we propose Vodka to address the above challenges. For resource isolation, we formalize the change of query cardinalities under dynamic modifications, and manipulate the cardinalities of various query operators to ensure consistent query complexity comparisons under any data size. For consistency model, we design a column value grained version management strategy based on which query-oriented freshness is calculated. For data sharing, we design a lightweight point query driven method to check the synchronization status accurately. We finally conduct extensive experiments on three representative systems to justify our designs and provide insights for future system developments.
Zitieren
APA
Hu, Z., Weng, S., Pan, Z., Zhang, R., Yang, C., Cai, P., Zhou, X., Xu, Q., & Yang, C. (2025). Vodka: Rethink Benchmarking Philosophy in HTAP Systems. Proceedings of the VLDB Endowment, 19(3), 481-494. https://doi.org/10.14778/3778092.3778107
Vancouver
Hu Z, Weng S, Pan Z, Zhang R, Yang C, Cai P, et al. Vodka: Rethink Benchmarking Philosophy in HTAP Systems. Proceedings of the VLDB Endowment. 2025;19(3):481-494. doi:10.14778/3778092.3778107
BibTeX
@article{Hu2025,
author = {Hu, Zirui and Weng, Siyang and Pan, Zhicheng and Zhang, Rong and Yang, Chengcheng and Cai, Peng and Zhou, Xuan and Xu, Quanqing and Yang, Chuanhui},
title = {Vodka: Rethink Benchmarking Philosophy in HTAP Systems},
journal = {Proceedings of the VLDB Endowment},
year = {2025},
volume = {19},
number = {3},
pages = {481--494},
doi = {10.14778/3778092.3778107}
}
EUVIMED