LICO: An SIMD-Aware High-Performance Learned Inverted Index Compression Framework
Proceedings of the ACM on Management of Data · 18.05.2026 · 4 (3) · 1-27
DOI: 10.1145/3802079 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the ACM on Management of Data, online erschienen am 18.05.2026. Verfasst von Xianyu Zhu und 6 weiteren Autor:innen. Die Arbeit nennt 64 Literaturangaben. Gefördert von: National Natural Science Foundation of China, A3 Foresight Program.
Abstract (Originalsprache)
Inverted indexes (a.k.a. posting lists) are core data structures in search engines and database systems, where compression is crucial to reduce memory footprint and accelerate query processing. The key challenge lies in encoding a sorted list of integer identifiers in a compact, lossless form while supporting fast decoding. Motivated by recent studies on learned data structures, this work presents LICO, a novel L earned I nverted index CO mpression framework that encodes sorted integers with error-bounded machine learning models and auxiliary residual arrays for lossless reconstruction. Compared to classical schemes such as P4Delta and Elias-Fano, and recent learning-based approaches such as LA-vector and LeCo, LICO offers three key advantages: (1) a succinct data structure explicitly designed for leveraging parallelism offered by modern hardware; (2) fully automatic adaptation to data distributions without hand-tuned hyperparameters; and (3) rigorous theoretical guarantees on compression ratios. Extensive experiments on web-scale datasets and query workloads show that LICO achieves Pareto-optimal trade-offs between index size and query latency. All code and artifacts are available at: https://github.com/xianyuzhuruc/LICO.
Förderung
- National Natural Science Foundation of China
- A3 Foresight Program
Zitieren
APA
Zhu, X., Liu, Q., Zhang, G., Sha, Z., Liao, J., Hu, S., & Chen, L. (2026). LICO: An SIMD-Aware High-Performance Learned Inverted Index Compression Framework. Proceedings of the ACM on Management of Data, 4(3), 1-27. https://doi.org/10.1145/3802079
Vancouver
Zhu X, Liu Q, Zhang G, Sha Z, Liao J, Hu S, et al. LICO: An SIMD-Aware High-Performance Learned Inverted Index Compression Framework. Proceedings of the ACM on Management of Data. 2026;4(3):1-27. doi:10.1145/3802079
BibTeX
@article{Zhu2026,
author = {Zhu, Xianyu and Liu, Qiyu and Zhang, Guangyi and Sha, Zhibing and Liao, Jianwei and Hu, Sha and Chen, Lei},
title = {LICO: An SIMD-Aware High-Performance Learned Inverted Index Compression Framework},
journal = {Proceedings of the ACM on Management of Data},
year = {2026},
volume = {4},
number = {3},
pages = {1--27},
doi = {10.1145/3802079}
}
EUVIMED