ACORN: Performant and Predicate-Agnostic Search Over Vector Embeddings and Structured Data
Proceedings of the ACM on Management of Data · 29.05.2024 · 2 (3) · 1-27
DOI: 10.1145/3654923 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the ACM on Management of Data, online erschienen am 30.05.2024. Verfasst von Liana Patel und 3 weiteren Autor:innen. Die Arbeit wurde bisher 69-mal zitiert (Crossref) und nennt 69 Literaturangaben.
Abstract (Originalsprache)
Applications increasingly leverage mixed-modality data, and must jointly search over vector data, such as embedded images, text and video, as well as structured data, such as attributes and keywords. Proposed methods for this hybrid search setting either suffer from poor performance or support a severely restricted set of search predicates (e.g., only small sets of equality predicates), making them impractical for many applications. To address this, we present ACORN, an approach for performant and predicate-agnostic hybrid search. ACORN builds on Hierarchical Navigable Small Worlds (HNSW), a state-of-the-art graph-based approximate nearest neighbor index, and can be implemented efficiently by extending existing HNSW libraries. ACORN introduces the idea of predicate subgraph traversal to emulate a theoretically ideal, but impractical, hybrid search strategy. ACORN's predicate-agnostic construction algorithm is designed to enable this effective search strategy, while supporting a wide array of predicate sets and query semantics. We systematically evaluate ACORN on both prior benchmark datasets, with simple, low-cardinality predicate sets, and complex multi-modal datasets not supported by prior methods. We show that ACORN achieves state-of-the-art performance on all datasets, outperforming prior methods with 2--1,000× higher throughput at a fixed recall. Our code is available at: https://github.com/stanford-futuredata/ACORN.
Zitieren
APA
Patel, L., Kraft, P., Guestrin, C., & Zaharia, M. (2024). ACORN: Performant and Predicate-Agnostic Search Over Vector Embeddings and Structured Data. Proceedings of the ACM on Management of Data, 2(3), 1-27. https://doi.org/10.1145/3654923
Vancouver
Patel L, Kraft P, Guestrin C, Zaharia M. ACORN: Performant and Predicate-Agnostic Search Over Vector Embeddings and Structured Data. Proceedings of the ACM on Management of Data. 2024;2(3):1-27. doi:10.1145/3654923
BibTeX
@article{Patel2024,
author = {Patel, Liana and Kraft, Peter and Guestrin, Carlos and Zaharia, Matei},
title = {ACORN: Performant and Predicate-Agnostic Search Over Vector Embeddings and Structured Data},
journal = {Proceedings of the ACM on Management of Data},
year = {2024},
volume = {2},
number = {3},
pages = {1--27},
doi = {10.1145/3654923}
}
EUVIMED