RED-ANNS: An RDMA-Enabled Distributed Framework for Graph-Based Approximate Nearest Neighbor Search
Proceedings of the VLDB Endowment · 01.11.2025 · 19 (3) · 399-412
DOI: 10.14778/3778092.3778101 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the VLDB Endowment, online erschienen am 18.03.2026. Verfasst von Yue Chen und 9 weiteren Autor:innen. Die Arbeit nennt 57 Literaturangaben.
Abstract (Originalsprache)
Unstructured data, such as text and images, are converted into high-dimensional vectors to capture their semantics for effective data retrieval. Approximate Nearest Neighbor Search (ANNS) over these vectors has become a fundamental technique in many domains, including retrieval-augmented generation and recommendation systems. With an ever-increasing volume of data, existing distributed solutions typically segment data across multiple machine nodes, handling query processing in a MapReduce-style approach. However, this approach suffers from reduced indexing efficiency and increased computational overhead, resulting in limited performance enhancement despite investing several times more resources. In this work, we propose RED-ANNS, a distributed ANNS approach on an RDMA network. The core idea is to maintain a logically full graph across a shared memory space of multiple nodes and utilize Remote Direct Memory Access (RDMA) to search the distributed graph, thereby avoiding the reduction in indexing efficiency caused by segmentation. The key to making this approach effective is to address the overhead associated with remote accesses. We reduce remote access frequency through locality-aware data placement and affinity-based query scheduling, while we hide remote access latency with a dependency-relaxed best-first search algorithm. Extensive experiments demonstrate that RED-ANNS achieves a performance improvement of up to 2.5× over MapReduce-style approaches and up to 5.3× over open source vector databases.
Zitieren
APA
Chen, Y., Zhang, K., Chen, S., Xiao, S., Zou, X., Ren, R., Jing, Y., Wang, X. S., Cao, L., & Wan, M. (2025). RED-ANNS: An RDMA-Enabled Distributed Framework for Graph-Based Approximate Nearest Neighbor Search. Proceedings of the VLDB Endowment, 19(3), 399-412. https://doi.org/10.14778/3778092.3778101
Vancouver
Chen Y, Zhang K, Chen S, Xiao S, Zou X, Ren R, et al. RED-ANNS: An RDMA-Enabled Distributed Framework for Graph-Based Approximate Nearest Neighbor Search. Proceedings of the VLDB Endowment. 2025;19(3):399-412. doi:10.14778/3778092.3778101
BibTeX
@article{Chen2025,
author = {Chen, Yue and Zhang, Kai and Chen, Sipeng and Xiao, Shihai and Zou, Xiaomin and Ren, Ren and Jing, Yinan and Wang, X. Sean and Cao, Li and Wan, Mingxiang},
title = {RED-ANNS: An RDMA-Enabled Distributed Framework for Graph-Based Approximate Nearest Neighbor Search},
journal = {Proceedings of the VLDB Endowment},
year = {2025},
volume = {19},
number = {3},
pages = {399--412},
doi = {10.14778/3778092.3778101}
}
EUVIMED