EUVIMEDEUVIMED entdecken
Crossref

A Large-scale Analysis of Hundreds of In-memory Key-value Cache Clusters at Twitter

Juncheng Yang, Yao Yue, K. V. Rashmi

ACM Transactions on Storage · 31.08.2021 · 17 (3) · 1-35

DOI: 10.1145/3468521 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Storage, online erschienen am 16.08.2021. Verfasst von Juncheng Yang und 2 weiteren Autor:innen. Die Arbeit wurde bisher 108-mal zitiert (Crossref) und nennt 117 Literaturangaben. Gefördert von: NSF.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Modern web services use in-memory caching extensively to increase throughput and reduce latency. There have been several workload analyses of production systems that have fueled research in improving the effectiveness of in-memory caching systems. However, the coverage is still sparse considering the wide spectrum of industrial cache use cases. In this work, we significantly further the understanding of real-world cache workloads by collecting production traces from 153 in-memory cache clusters at Twitter, sifting through over 80 TB of data, and sometimes interpreting the workloads in the context of the business logic behind them. We perform a comprehensive analysis to characterize cache workloads based on traffic pattern, time-to-live (TTL), popularity distribution, and size distribution. A fine-grained view of different workloads uncover the diversity of use cases: many are far more write-heavy or more skewed than previously shown and some display unique temporal patterns. We also observe that TTL is an important and sometimes defining parameter of cache working sets. Our simulations show that ideal replacement strategy in production caches can be surprising, for example, FIFO works the best for a large number of workloads.

Förderung

  • NSF

Zitieren

APA

Yang, J., Yue, Y., & Rashmi, K. V. (2021). A Large-scale Analysis of Hundreds of In-memory Key-value Cache Clusters at Twitter. ACM Transactions on Storage, 17(3), 1-35. https://doi.org/10.1145/3468521

Vancouver

Yang J, Yue Y, Rashmi KV. A Large-scale Analysis of Hundreds of In-memory Key-value Cache Clusters at Twitter. ACM Transactions on Storage. 2021;17(3):1-35. doi:10.1145/3468521

BibTeX
@article{Yang2021,
  author = {Yang, Juncheng and Yue, Yao and Rashmi, K. V.},
  title = {A Large-scale Analysis of Hundreds of In-memory Key-value Cache Clusters at Twitter},
  journal = {ACM Transactions on Storage},
  year = {2021},
  volume = {17},
  number = {3},
  pages = {1--35},
  doi = {10.1145/3468521}
}
Kostenlos starten →