EUVIMEDEUVIMED entdecken
Crossref

Exploiting Cloud Object Storage for High-Performance Analytics

Dominik Durner, Viktor Leis, Thomas Neumann

Proceedings of the VLDB Endowment · 2023-07 · 16 (11) · 2769-2782

DOI: 10.14778/3611479.3611486 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the VLDB Endowment, online erschienen am 24.08.2023. Verfasst von Dominik Durner und 2 weiteren Autor:innen. Die Arbeit wurde bisher 47-mal zitiert (Crossref) und nennt 92 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Elasticity of compute and storage is crucial for analytical cloud database systems. All cloud vendors provide disaggregated object stores, which can be used as storage backend for analytical query engines. Until recently, local storage was unavoidable to process large tables efficiently due to the bandwidth limitations of the network infrastructure in public clouds. However, the gap between remote network and local NVMe bandwidth is closing, making cloud storage more attractive. This paper presents a blueprint for performing efficient analytics directly on cloud object stores. We derive cost- and performance-optimal retrieval configurations for cloud object stores with the first in-depth study of this foundational service in the context of analytical query processing. For achieving high retrieval performance, we present AnyBlob , a novel download manager for query engines that optimizes throughput while minimizing CPU usage. We discuss the integration of high-performance data retrieval in query engines and demonstrate it by incorporating AnyBlob in our database system Umbra. Our experiments show that even without caching, Umbra with integrated AnyBlob achieves similar performance to state-of-the-art cloud data warehouses that cache data on local SSDs while improving resource elasticity.

Zitieren

APA

Durner, D., Leis, V., & Neumann, T. (2023). Exploiting Cloud Object Storage for High-Performance Analytics. Proceedings of the VLDB Endowment, 16(11), 2769-2782. https://doi.org/10.14778/3611479.3611486

Vancouver

Durner D, Leis V, Neumann T. Exploiting Cloud Object Storage for High-Performance Analytics. Proceedings of the VLDB Endowment. 2023;16(11):2769-2782. doi:10.14778/3611479.3611486

BibTeX
@article{Durner2023,
  author = {Durner, Dominik and Leis, Viktor and Neumann, Thomas},
  title = {Exploiting Cloud Object Storage for High-Performance Analytics},
  journal = {Proceedings of the VLDB Endowment},
  year = {2023},
  volume = {16},
  number = {11},
  pages = {2769--2782},
  doi = {10.14778/3611479.3611486}
}
Kostenlos starten →