A Large-scale Analysis of Hundreds of In-memory Key-value Cache Clusters at Twitter
ACM Transactions on Storage · 31.08.2021 · 17 (3) · 1-35
DOI: 10.1145/3468521 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Storage, online erschienen am 16.08.2021. Verfasst von Juncheng Yang und 2 weiteren Autor:innen. Die Arbeit wurde bisher 108-mal zitiert (Crossref) und nennt 117 Literaturangaben. Gefördert von: NSF.
Abstract (Originalsprache)
Modern web services use in-memory caching extensively to increase throughput and reduce latency. There have been several workload analyses of production systems that have fueled research in improving the effectiveness of in-memory caching systems. However, the coverage is still sparse considering the wide spectrum of industrial cache use cases. In this work, we significantly further the understanding of real-world cache workloads by collecting production traces from 153 in-memory cache clusters at Twitter, sifting through over 80 TB of data, and sometimes interpreting the workloads in the context of the business logic behind them. We perform a comprehensive analysis to characterize cache workloads based on traffic pattern, time-to-live (TTL), popularity distribution, and size distribution. A fine-grained view of different workloads uncover the diversity of use cases: many are far more write-heavy or more skewed than previously shown and some display unique temporal patterns. We also observe that TTL is an important and sometimes defining parameter of cache working sets. Our simulations show that ideal replacement strategy in production caches can be surprising, for example, FIFO works the best for a large number of workloads.
Förderung
- NSF
Zitieren
APA
Yang, J., Yue, Y., & Rashmi, K. V. (2021). A Large-scale Analysis of Hundreds of In-memory Key-value Cache Clusters at Twitter. ACM Transactions on Storage, 17(3), 1-35. https://doi.org/10.1145/3468521
Vancouver
Yang J, Yue Y, Rashmi KV. A Large-scale Analysis of Hundreds of In-memory Key-value Cache Clusters at Twitter. ACM Transactions on Storage. 2021;17(3):1-35. doi:10.1145/3468521
BibTeX
@article{Yang2021,
author = {Yang, Juncheng and Yue, Yao and Rashmi, K. V.},
title = {A Large-scale Analysis of Hundreds of In-memory Key-value Cache Clusters at Twitter},
journal = {ACM Transactions on Storage},
year = {2021},
volume = {17},
number = {3},
pages = {1--35},
doi = {10.1145/3468521}
}
EUVIMED