A Comparison of HDFS Compact Data Formats: Avro Versus Parquet
Mokslas - Lietuvos ateitis · 04.07.2017 · 9 (3) · 267-276
DOI: 10.3846/mla.2017.1033 ↗Kurz gefasst
Fachartikel in der Zeitschrift Mokslas - Lietuvos ateitis, online erschienen am 04.07.2017. Verfasst von Daiga Plase und 2 weiteren Autor:innen. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 29 Literaturangaben.
Abstract (Originalsprache)
In this paper, file formats like Avro and Parquet are compared with text formats to evaluate the performance of the data queries. Different data query patterns have been evaluated. Cloudera’s open-source Apache Hadoop distribution CDH 5.4 has been chosen for the experiments presented in this article. The results show that compact data formats (Avro and Parquet) take up less storage space when compared with plain text data formats because of binary data format and compression advantage. Furthermore, data queries from the column based data format Parquet are faster when compared with text data formats and Avro.
Zitieren
APA
Plase, D., Niedrite, L., & Taranovs, R. (2017). A Comparison of HDFS Compact Data Formats: Avro Versus Parquet. Mokslas - Lietuvos ateitis, 9(3), 267-276. https://doi.org/10.3846/mla.2017.1033
Vancouver
Plase D, Niedrite L, Taranovs R. A Comparison of HDFS Compact Data Formats: Avro Versus Parquet. Mokslas - Lietuvos ateitis. 2017;9(3):267-276. doi:10.3846/mla.2017.1033
BibTeX
@article{Plase2017,
author = {Plase, Daiga and Niedrite, Laila and Taranovs, Romans},
title = {A Comparison of HDFS Compact Data Formats: Avro Versus Parquet},
journal = {Mokslas - Lietuvos ateitis},
year = {2017},
volume = {9},
number = {3},
pages = {267--276},
doi = {10.3846/mla.2017.1033}
}
EUVIMED