EUVIMEDEUVIMED entdecken
Crossref

Declarative Sub-Operators for Universal Data Processing

Michael Jungmair, Jana Giceva

Proceedings of the VLDB Endowment · 2023-07 · 16 (11) · 3461-3474

DOI: 10.14778/3611479.3611539 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the VLDB Endowment, online erschienen am 24.08.2023. Verfasst von Michael Jungmair und 1 weiteren Autor:innen. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 49 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Data processing systems face the challenge of supporting increasingly diverse workloads efficiently. At the same time, they are already bloated with internal complexity, and it is not clear how new hardware can be supported sustainably. In this paper, we aim to resolve these issues by proposing a unified abstraction layer based on declarative sub-operators in addition to relational operators. By exposing this layer to users, they can express their non-relational workloads declaratively with sub-operators. Furthermore, the proposed sub-operators decouple the semantic implementation of operators from the efficient imperative implementation, reducing the implementation complexity for relational operators. Finally, through fine-grained automatic optimizations, the declarative sub-operators allow for automatic morsel-driven parallelism. We demonstrate the benefits not only by providing a specific set of sub-operators but also implementing them in a compiling query engine. With thorough evaluation and analysis, we show that we can support a richer set of workloads while retaining the development complexity low and being competitive in performance even with specialized systems.

Zitieren

APA

Jungmair, M., & Giceva, J. (2023). Declarative Sub-Operators for Universal Data Processing. Proceedings of the VLDB Endowment, 16(11), 3461-3474. https://doi.org/10.14778/3611479.3611539

Vancouver

Jungmair M, Giceva J. Declarative Sub-Operators for Universal Data Processing. Proceedings of the VLDB Endowment. 2023;16(11):3461-3474. doi:10.14778/3611479.3611539

BibTeX
@article{Jungmair2023,
  author = {Jungmair, Michael and Giceva, Jana},
  title = {Declarative Sub-Operators for Universal Data Processing},
  journal = {Proceedings of the VLDB Endowment},
  year = {2023},
  volume = {16},
  number = {11},
  pages = {3461--3474},
  doi = {10.14778/3611479.3611539}
}
Kostenlos starten →