EUVIMEDEUVIMED entdecken
Crossref

Improving Time Series Data Compression in Apache IoTDB

Yuxin Tang, Feng Zhang, Jiawei Guan, Yuan Tian, Xiangdong Huang, Chen Wang, Jianmin Wang, Xiaoyong Du

Proceedings of the VLDB Endowment · 2025-06 · 18 (10) · 3406-3420

DOI: 10.14778/3748191.3748204 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the VLDB Endowment, online erschienen am 04.09.2025. Verfasst von Yuxin Tang und 7 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 100 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Time series data are generated on an unprecedented scale across various domains. Although traditional compression techniques reduce storage costs, they typically require full decompression before querying, leading to increased latency and higher resource consumption. Homomorphic compression (HC), which enables direct computation on the compressed data without decompression, shows the potential for both reduced storage and improved query performance. However, the unique complexities of time series data pose challenges that current HC methods have yet to adequately address. In this paper, we introduce HC theory in the time series domain, transformatively enabling HC to time series database queries. Building on our theory, we develop CompressIoTDB - a novel homomorphic compression framework integrated into Apache IoTDB. By leveraging our proposed CompColumn structure, our framework supports a wide range of query operators, including filtering, aggregation, and window-based functions, all while maintaining data in its compressed form. Furthermore, we incorporate system-level optimizations such as late decompression and dynamic auxiliary management to further boost query efficiency. Extensive experiments show that CompressIoTDB significantly enhances query processing for time series data, achieving an average throughput improvement of 53.4% and memory usage reduction of 20%.

Zitieren

APA

Tang, Y., Zhang, F., Guan, J., Tian, Y., Huang, X., Wang, C., Wang, J., & Du, X. (2025). Improving Time Series Data Compression in Apache IoTDB. Proceedings of the VLDB Endowment, 18(10), 3406-3420. https://doi.org/10.14778/3748191.3748204

Vancouver

Tang Y, Zhang F, Guan J, Tian Y, Huang X, Wang C, et al. Improving Time Series Data Compression in Apache IoTDB. Proceedings of the VLDB Endowment. 2025;18(10):3406-3420. doi:10.14778/3748191.3748204

BibTeX
@article{Tang2025,
  author = {Tang, Yuxin and Zhang, Feng and Guan, Jiawei and Tian, Yuan and Huang, Xiangdong and Wang, Chen and Wang, Jianmin and Du, Xiaoyong},
  title = {Improving Time Series Data Compression in Apache IoTDB},
  journal = {Proceedings of the VLDB Endowment},
  year = {2025},
  volume = {18},
  number = {10},
  pages = {3406--3420},
  doi = {10.14778/3748191.3748204}
}
Kostenlos starten →