Two Birds With One Stone: Designing a Hybrid Cloud Storage Engine for HTAP
Proceedings of the VLDB Endowment · 2024-07 · 17 (11) · 3290-3303
DOI: 10.14778/3681954.3682001 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the VLDB Endowment, online erschienen am 30.08.2024. Verfasst von Tobias Schmidt und 3 weiteren Autor:innen. Die Arbeit wurde bisher 19-mal zitiert (Crossref) und nennt 76 Literaturangaben.
Abstract (Originalsprache)
Businesses are increasingly demanding real-time analytics on up-to-date data. However, current solutions fail to efficiently combine transactional and analytical processing in a single system. Instead, they rely on extract-transform-load pipelines to transfer transactional data to analytical systems, which introduces a significant delay in the time-to-insight. In this paper, we address this need by proposing a new storage engine design for the cloud, called Colibri , that enables hybrid transactional and analytical processing beyond main memory. Colibri features a hybrid column-row store optimized for both workloads, leveraging emerging hardware trends. It effectively separates hot and cold data to accommodate diverse access patterns and storage devices. Our extensive experiments showcase up to 10x performance improvements for processing hybrid workloads on solid-state drives and cloud object stores.
Zitieren
APA
Schmidt, T., Durner, D., Leis, V., & Neumann, T. (2024). Two Birds With One Stone: Designing a Hybrid Cloud Storage Engine for HTAP. Proceedings of the VLDB Endowment, 17(11), 3290-3303. https://doi.org/10.14778/3681954.3682001
Vancouver
Schmidt T, Durner D, Leis V, Neumann T. Two Birds With One Stone: Designing a Hybrid Cloud Storage Engine for HTAP. Proceedings of the VLDB Endowment. 2024;17(11):3290-3303. doi:10.14778/3681954.3682001
BibTeX
@article{Schmidt2024,
author = {Schmidt, Tobias and Durner, Dominik and Leis, Viktor and Neumann, Thomas},
title = {Two Birds With One Stone: Designing a Hybrid Cloud Storage Engine for HTAP},
journal = {Proceedings of the VLDB Endowment},
year = {2024},
volume = {17},
number = {11},
pages = {3290--3303},
doi = {10.14778/3681954.3682001}
}
EUVIMED