EUVIMEDEUVIMED entdecken
Crossref

LICO: An SIMD-Aware High-Performance Learned Inverted Index Compression Framework

Xianyu Zhu, Qiyu Liu, Guangyi Zhang, Zhibing Sha, Jianwei Liao, Sha Hu, Lei Chen

Proceedings of the ACM on Management of Data · 18.05.2026 · 4 (3) · 1-27

DOI: 10.1145/3802079 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the ACM on Management of Data, online erschienen am 18.05.2026. Verfasst von Xianyu Zhu und 6 weiteren Autor:innen. Die Arbeit nennt 64 Literaturangaben. Gefördert von: National Natural Science Foundation of China, A3 Foresight Program.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Inverted indexes (a.k.a. posting lists) are core data structures in search engines and database systems, where compression is crucial to reduce memory footprint and accelerate query processing. The key challenge lies in encoding a sorted list of integer identifiers in a compact, lossless form while supporting fast decoding. Motivated by recent studies on learned data structures, this work presents LICO, a novel L earned I nverted index CO mpression framework that encodes sorted integers with error-bounded machine learning models and auxiliary residual arrays for lossless reconstruction. Compared to classical schemes such as P4Delta and Elias-Fano, and recent learning-based approaches such as LA-vector and LeCo, LICO offers three key advantages: (1) a succinct data structure explicitly designed for leveraging parallelism offered by modern hardware; (2) fully automatic adaptation to data distributions without hand-tuned hyperparameters; and (3) rigorous theoretical guarantees on compression ratios. Extensive experiments on web-scale datasets and query workloads show that LICO achieves Pareto-optimal trade-offs between index size and query latency. All code and artifacts are available at: https://github.com/xianyuzhuruc/LICO.

Förderung

  • National Natural Science Foundation of China
  • A3 Foresight Program

Zitieren

APA

Zhu, X., Liu, Q., Zhang, G., Sha, Z., Liao, J., Hu, S., & Chen, L. (2026). LICO: An SIMD-Aware High-Performance Learned Inverted Index Compression Framework. Proceedings of the ACM on Management of Data, 4(3), 1-27. https://doi.org/10.1145/3802079

Vancouver

Zhu X, Liu Q, Zhang G, Sha Z, Liao J, Hu S, et al. LICO: An SIMD-Aware High-Performance Learned Inverted Index Compression Framework. Proceedings of the ACM on Management of Data. 2026;4(3):1-27. doi:10.1145/3802079

BibTeX
@article{Zhu2026,
  author = {Zhu, Xianyu and Liu, Qiyu and Zhang, Guangyi and Sha, Zhibing and Liao, Jianwei and Hu, Sha and Chen, Lei},
  title = {LICO: An SIMD-Aware High-Performance Learned Inverted Index Compression Framework},
  journal = {Proceedings of the ACM on Management of Data},
  year = {2026},
  volume = {4},
  number = {3},
  pages = {1--27},
  doi = {10.1145/3802079}
}
Kostenlos starten →