EUVIMEDEUVIMED entdecken
Crossref

Kirin: Efficient In-Storage Learned Compaction for LSM-Trees via System-Algorithm Co-Design

Guifeng Wang, Shengan Zheng, Penghao Sun, Jin Pu, Kaijiang Deng, Bowen Zhang, Weihan Kong, Cong Zhou, Yifan Hua, Linpeng Huang

Proceedings of the VLDB Endowment · 01.05.2026 · 19 (9) · 1991-2004

DOI: 10.14778/3819518.3819529 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the VLDB Endowment, online erschienen am 19.08.2026. Verfasst von Guifeng Wang und 9 weiteren Autor:innen. Die Arbeit nennt 79 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The log-structured merge-trees (LSM-trees) are widely used in modern Key-Value (KV) stores, offering strong write performance but facing significant inefficiencies in compaction and indexing. While recent researches have integrated learned indexes with LSM-trees to address these inefficiencies, their integration remains hindered by excessive cold data movement, limited parallelism in model training, and the decoupled nature of compaction and training. In this paper, we present Kirin, a hybrid KV store that synergistically integrates LSM-tree and learned index, and leverages computational storage devices (CSDs) to offload data-intensive tasks. Kirin introduces a novel learned compaction approach that embeds model training directly into the compaction process to conceal training latency and enable timely model updates. Kirin also employs a collaborative approach between the host and CSD to parallelize compaction and minimize storage access during indexing. Our experiments with DaisyPlus OpenSSD demonstrate that Kirin outperforms existing solutions in both read and write throughput by a large margin, while maintaining low read latency under heavy write workloads.

Zitieren

APA

Wang, G., Zheng, S., Sun, P., Pu, J., Deng, K., Zhang, B., Kong, W., Zhou, C., Hua, Y., & Huang, L. (2026). Kirin: Efficient In-Storage Learned Compaction for LSM-Trees via System-Algorithm Co-Design. Proceedings of the VLDB Endowment, 19(9), 1991-2004. https://doi.org/10.14778/3819518.3819529

Vancouver

Wang G, Zheng S, Sun P, Pu J, Deng K, Zhang B, et al. Kirin: Efficient In-Storage Learned Compaction for LSM-Trees via System-Algorithm Co-Design. Proceedings of the VLDB Endowment. 2026;19(9):1991-2004. doi:10.14778/3819518.3819529

BibTeX
@article{Wang2026,
  author = {Wang, Guifeng and Zheng, Shengan and Sun, Penghao and Pu, Jin and Deng, Kaijiang and Zhang, Bowen and Kong, Weihan and Zhou, Cong and Hua, Yifan and Huang, Linpeng},
  title = {Kirin: Efficient In-Storage Learned Compaction for LSM-Trees via System-Algorithm Co-Design},
  journal = {Proceedings of the VLDB Endowment},
  year = {2026},
  volume = {19},
  number = {9},
  pages = {1991--2004},
  doi = {10.14778/3819518.3819529}
}
Kostenlos starten →