Bridging Software-Hardware for CXL Memory Disaggregation in Billion-Scale Nearest Neighbor Search
ACM Transactions on Storage · 31.05.2024 · 20 (2) · 1-30
DOI: 10.1145/3639471 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Storage, online erschienen am 19.02.2024. Verfasst von Junhyeok Jang und 5 weiteren Autor:innen. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 74 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
We propose CXL-ANNS , a software-hardware collaborative approach to enable scalable approximate nearest neighbor search (ANNS) services. To this end, we first disaggregate DRAM from the host via compute express link (CXL) and place all essential datasets into its memory pool. While this CXL memory pool allows ANNS to handle billion-point graphs without an accuracy loss, we observe that the search performance significantly degrades because of CXL’s far-memory-like characteristics. To address this, CXL-ANNS considers the node-level relationship and caches the neighbors in local memory, which are expected to visit most frequently. For the uncached nodes, CXL-ANNS prefetches a set of nodes most likely to visit soon by understanding the graph traversing behaviors of ANNS. CXL-ANNS is also aware of the architectural structures of the CXL interconnect network and lets different hardware components collaborate with each other for the search. Furthermore, it relaxes the execution dependency of neighbor search tasks and allows ANNS to utilize all hardware in the CXL network in parallel. Our evaluation shows that CXL-ANNS exhibits 93.3% lower query latency than state-of-the-art ANNS platforms that we tested. CXL-ANNS also outperforms an oracle ANNS system that has unlimited local DRAM capacity by 68.0%, in terms of latency.
Zitieren
APA
Jang, J., Choi, H., Bae, H., Lee, S., Kwon, M., & Jung, M. (2024). Bridging Software-Hardware for CXL Memory Disaggregation in Billion-Scale Nearest Neighbor Search. ACM Transactions on Storage, 20(2), 1-30. https://doi.org/10.1145/3639471
Vancouver
Jang J, Choi H, Bae H, Lee S, Kwon M, Jung M. Bridging Software-Hardware for CXL Memory Disaggregation in Billion-Scale Nearest Neighbor Search. ACM Transactions on Storage. 2024;20(2):1-30. doi:10.1145/3639471
BibTeX
@article{Jang2024,
author = {Jang, Junhyeok and Choi, Hanjin and Bae, Hanyeoreum and Lee, Seungjun and Kwon, Miryeong and Jung, Myoungsoo},
title = {Bridging Software-Hardware for CXL Memory Disaggregation in Billion-Scale Nearest Neighbor Search},
journal = {ACM Transactions on Storage},
year = {2024},
volume = {20},
number = {2},
pages = {1--30},
doi = {10.1145/3639471}
}
EUVIMED