EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

RocksDB: Evolution of Development Priorities in a Key-value Store Serving Large-scale Applications

Siying Dong, Andrew Kryczka, Yanqin Jin, Michael Stumm

ACM Transactions on Storage · 30.11.2021 · 17 (4) · 1-32

DOI: 10.1145/3483840 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Storage, online erschienen am 15.10.2021. Verfasst von Siying Dong und 3 weiteren Autor:innen. Die Arbeit wurde bisher 225-mal zitiert (Crossref) und nennt 100 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This article is an eight-year retrospective on development priorities for RocksDB, a key-value store developed at Facebook that targets large-scale distributed systems and that is optimized for Solid State Drives (SSDs). We describe how the priorities evolved over time as a result of hardware trends and extensive experiences running RocksDB at scale in production at a number of organizations: from optimizing write amplification, to space amplification, to CPU utilization. We describe lessons from running large-scale applications, including that resource allocation needs to be managed across different RocksDB instances, that data formats need to remain backward- and forward-compatible to allow incremental software rollouts, and that appropriate support for database replication and backups are needed. Lessons from failure handling taught us that data corruption errors needed to be detected earlier and that data integrity protection mechanisms are needed at every layer of the system. We describe improvements to the key-value interface. We describe a number of efforts that in retrospect proved to be misguided. Finally, we describe a number of open problems that could benefit from future research.

Zitieren

APA

Dong, S., Kryczka, A., Jin, Y., & Stumm, M. (2021). RocksDB: Evolution of Development Priorities in a Key-value Store Serving Large-scale Applications. ACM Transactions on Storage, 17(4), 1-32. https://doi.org/10.1145/3483840

Vancouver

Dong S, Kryczka A, Jin Y, Stumm M. RocksDB: Evolution of Development Priorities in a Key-value Store Serving Large-scale Applications. ACM Transactions on Storage. 2021;17(4):1-32. doi:10.1145/3483840

BibTeX
@article{Dong2021,
  author = {Dong, Siying and Kryczka, Andrew and Jin, Yanqin and Stumm, Michael},
  title = {RocksDB: Evolution of Development Priorities in a Key-value Store Serving Large-scale Applications},
  journal = {ACM Transactions on Storage},
  year = {2021},
  volume = {17},
  number = {4},
  pages = {1--32},
  doi = {10.1145/3483840}
}
Kostenlos starten →