Improving Time Series Data Compression in Apache IoTDB
Proceedings of the VLDB Endowment · 2025-06 · 18 (10) · 3406-3420
DOI: 10.14778/3748191.3748204 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the VLDB Endowment, online erschienen am 04.09.2025. Verfasst von Yuxin Tang und 7 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 100 Literaturangaben.
Abstract (Originalsprache)
Time series data are generated on an unprecedented scale across various domains. Although traditional compression techniques reduce storage costs, they typically require full decompression before querying, leading to increased latency and higher resource consumption. Homomorphic compression (HC), which enables direct computation on the compressed data without decompression, shows the potential for both reduced storage and improved query performance. However, the unique complexities of time series data pose challenges that current HC methods have yet to adequately address. In this paper, we introduce HC theory in the time series domain, transformatively enabling HC to time series database queries. Building on our theory, we develop CompressIoTDB - a novel homomorphic compression framework integrated into Apache IoTDB. By leveraging our proposed CompColumn structure, our framework supports a wide range of query operators, including filtering, aggregation, and window-based functions, all while maintaining data in its compressed form. Furthermore, we incorporate system-level optimizations such as late decompression and dynamic auxiliary management to further boost query efficiency. Extensive experiments show that CompressIoTDB significantly enhances query processing for time series data, achieving an average throughput improvement of 53.4% and memory usage reduction of 20%.
Zitieren
APA
Tang, Y., Zhang, F., Guan, J., Tian, Y., Huang, X., Wang, C., Wang, J., & Du, X. (2025). Improving Time Series Data Compression in Apache IoTDB. Proceedings of the VLDB Endowment, 18(10), 3406-3420. https://doi.org/10.14778/3748191.3748204
Vancouver
Tang Y, Zhang F, Guan J, Tian Y, Huang X, Wang C, et al. Improving Time Series Data Compression in Apache IoTDB. Proceedings of the VLDB Endowment. 2025;18(10):3406-3420. doi:10.14778/3748191.3748204
BibTeX
@article{Tang2025,
author = {Tang, Yuxin and Zhang, Feng and Guan, Jiawei and Tian, Yuan and Huang, Xiangdong and Wang, Chen and Wang, Jianmin and Du, Xiaoyong},
title = {Improving Time Series Data Compression in Apache IoTDB},
journal = {Proceedings of the VLDB Endowment},
year = {2025},
volume = {18},
number = {10},
pages = {3406--3420},
doi = {10.14778/3748191.3748204}
}
EUVIMED