EUVIMEDOpdag EUVIMED
Crossref

LICO: An SIMD-Aware High-Performance Learned Inverted Index Compression Framework

Xianyu Zhu, Qiyu Liu, Guangyi Zhang, Zhibing Sha, Jianwei Liao, Sha Hu, Lei Chen

Proceedings of the ACM on Management of Data · 2026-05-18 · 4 (3) · 1-27

DOI: 10.1145/3802079 ↗

At a glance

Journal article in Proceedings of the ACM on Management of Data, published online on 2026-05-18. Written by Xianyu Zhu and 6 co-authors. 64 references. Funded by: National Natural Science Foundation of China, A3 Foresight Program.

AbstractBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Inverted indexes (a.k.a. posting lists) are core data structures in search engines and database systems, where compression is crucial to reduce memory footprint and accelerate query processing. The key challenge lies in encoding a sorted list of integer identifiers in a compact, lossless form while supporting fast decoding. Motivated by recent studies on learned data structures, this work presents LICO, a novel L earned I nverted index CO mpression framework that encodes sorted integers with error-bounded machine learning models and auxiliary residual arrays for lossless reconstruction. Compared to classical schemes such as P4Delta and Elias-Fano, and recent learning-based approaches such as LA-vector and LeCo, LICO offers three key advantages: (1) a succinct data structure explicitly designed for leveraging parallelism offered by modern hardware; (2) fully automatic adaptation to data distributions without hand-tuned hyperparameters; and (3) rigorous theoretical guarantees on compression ratios. Extensive experiments on web-scale datasets and query workloads show that LICO achieves Pareto-optimal trade-offs between index size and query latency. All code and artifacts are available at: https://github.com/xianyuzhuruc/LICO.

Funding

  • National Natural Science Foundation of China
  • A3 Foresight Program

Cite

APA

Zhu, X., Liu, Q., Zhang, G., Sha, Z., Liao, J., Hu, S., & Chen, L. (2026). LICO: An SIMD-Aware High-Performance Learned Inverted Index Compression Framework. Proceedings of the ACM on Management of Data, 4(3), 1-27. https://doi.org/10.1145/3802079

Vancouver

Zhu X, Liu Q, Zhang G, Sha Z, Liao J, Hu S, et al. LICO: An SIMD-Aware High-Performance Learned Inverted Index Compression Framework. Proceedings of the ACM on Management of Data. 2026;4(3):1-27. doi:10.1145/3802079

BibTeX
@article{Zhu2026,
  author = {Zhu, Xianyu and Liu, Qiyu and Zhang, Guangyi and Sha, Zhibing and Liao, Jianwei and Hu, Sha and Chen, Lei},
  title = {LICO: An SIMD-Aware High-Performance Learned Inverted Index Compression Framework},
  journal = {Proceedings of the ACM on Management of Data},
  year = {2026},
  volume = {4},
  number = {3},
  pages = {1--27},
  doi = {10.1145/3802079}
}
Start for free →