A Contract-aware and Cost-effective LSM Store for Cloud Storage with Low Latency Spikes
ACM Transactions on Storage · 31.05.2024 · 20 (2) · 1-27
DOI: 10.1145/3643851 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Storage, online erschienen am 04.04.2024. Verfasst von Yuanhui Zhou und 8 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 54 Literaturangaben. Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China, Creative Research Group Project of NSFC.
Abstract (Originalsprache)
Cloud storage is gaining popularity because features such as pay-as-you-go significantly reduce storage costs. However, the community has not sufficiently explored its contract model and latency characteristics. As LSM-Tree-based key-value stores (LSM stores) become the building block for numerous cloud applications, how cloud storage would impact the performance of key-value accesses is vital. This study reveals the significant latency variances of Amazon Elastic Block Store (EBS) under various I/O pressures, which challenges LSM store read performance on cloud storage. To reduce the corresponding tail latency, we propose Calcspar, a contract-aware LSM store for cloud storage, which efficiently addresses the challenges by regulating the rate of I/O requests to cloud storage and absorbing surplus I/O requests with the data cache. We specifically developed a fluctuation-aware cache to lower the high latency brought on by workload fluctuations. Additionally, we build a congestion-aware IOPS allocator to reduce the impact of LSM store internal operations on read latency. We evaluated Calcspar on EBS with different real-world workloads and compared it to the cutting-edge LSM stores. The results show that Calcspar can significantly reduce tail latency while maintaining regular read and write performance, keeping the 99 th percentile latency under 550μs and reducing average latency by 66%. In addition, Calcspar has lower write prices and average latency compared to Cloud NoSQL services offered by cloud vendors.
Förderung
- National Key Research and Development Program of China
- National Natural Science Foundation of China
- Creative Research Group Project of NSFC
- Key Research and Development Program of Guangdong Province
Zitieren
APA
Zhou, Y., Zhou, J., Lu, K., Zhan, L., Xu, P., Wu, P., Chen, S., Liu, X., & Wan, J. (2024). A Contract-aware and Cost-effective LSM Store for Cloud Storage with Low Latency Spikes. ACM Transactions on Storage, 20(2), 1-27. https://doi.org/10.1145/3643851
Vancouver
Zhou Y, Zhou J, Lu K, Zhan L, Xu P, Wu P, et al. A Contract-aware and Cost-effective LSM Store for Cloud Storage with Low Latency Spikes. ACM Transactions on Storage. 2024;20(2):1-27. doi:10.1145/3643851
BibTeX
@article{Zhou2024,
author = {Zhou, Yuanhui and Zhou, Jian and Lu, Kai and Zhan, Ling and Xu, Peng and Wu, Peng and Chen, Shuning and Liu, Xian and Wan, Jiguang},
title = {A Contract-aware and Cost-effective LSM Store for Cloud Storage with Low Latency Spikes},
journal = {ACM Transactions on Storage},
year = {2024},
volume = {20},
number = {2},
pages = {1--27},
doi = {10.1145/3643851}
}
EUVIMED