Kirin: Efficient In-Storage Learned Compaction for LSM-Trees via System-Algorithm Co-Design
Proceedings of the VLDB Endowment · 01.05.2026 · 19 (9) · 1991-2004
DOI: 10.14778/3819518.3819529 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the VLDB Endowment, online erschienen am 19.08.2026. Verfasst von Guifeng Wang und 9 weiteren Autor:innen. Die Arbeit nennt 79 Literaturangaben.
Abstract (Originalsprache)
The log-structured merge-trees (LSM-trees) are widely used in modern Key-Value (KV) stores, offering strong write performance but facing significant inefficiencies in compaction and indexing. While recent researches have integrated learned indexes with LSM-trees to address these inefficiencies, their integration remains hindered by excessive cold data movement, limited parallelism in model training, and the decoupled nature of compaction and training. In this paper, we present Kirin, a hybrid KV store that synergistically integrates LSM-tree and learned index, and leverages computational storage devices (CSDs) to offload data-intensive tasks. Kirin introduces a novel learned compaction approach that embeds model training directly into the compaction process to conceal training latency and enable timely model updates. Kirin also employs a collaborative approach between the host and CSD to parallelize compaction and minimize storage access during indexing. Our experiments with DaisyPlus OpenSSD demonstrate that Kirin outperforms existing solutions in both read and write throughput by a large margin, while maintaining low read latency under heavy write workloads.
Zitieren
APA
Wang, G., Zheng, S., Sun, P., Pu, J., Deng, K., Zhang, B., Kong, W., Zhou, C., Hua, Y., & Huang, L. (2026). Kirin: Efficient In-Storage Learned Compaction for LSM-Trees via System-Algorithm Co-Design. Proceedings of the VLDB Endowment, 19(9), 1991-2004. https://doi.org/10.14778/3819518.3819529
Vancouver
Wang G, Zheng S, Sun P, Pu J, Deng K, Zhang B, et al. Kirin: Efficient In-Storage Learned Compaction for LSM-Trees via System-Algorithm Co-Design. Proceedings of the VLDB Endowment. 2026;19(9):1991-2004. doi:10.14778/3819518.3819529
BibTeX
@article{Wang2026,
author = {Wang, Guifeng and Zheng, Shengan and Sun, Penghao and Pu, Jin and Deng, Kaijiang and Zhang, Bowen and Kong, Weihan and Zhou, Cong and Hua, Yifan and Huang, Linpeng},
title = {Kirin: Efficient In-Storage Learned Compaction for LSM-Trees via System-Algorithm Co-Design},
journal = {Proceedings of the VLDB Endowment},
year = {2026},
volume = {19},
number = {9},
pages = {1991--2004},
doi = {10.14778/3819518.3819529}
}
EUVIMED