Unlocking PIM-Core Capabilities for Efficient ANNS on Commodity Processing-in-Memory Hardware
ACM Transactions on Storage · 31.08.2026 · 22 (3) · 1-39
DOI: 10.1145/3806055 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Storage, online erschienen am 27.07.2026. Verfasst von Puqing Wu und 7 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 74 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Beijing Natural Science Foundation, National Natural Science Foundation of China, PCL-CMCC Foundation for Science and Innovation.
Abstract (Originalsprache)
Approximate Nearest Neighbor Search (ANNS) plays a key role in database and AI infrastructure. It exhibits extremely high memory intensity with a ~1:1 compute-to-memory access ratio. Commodity Processing-in-Memory (PIM) hardware, such as the first real-world commercial product (UPMEM), is promising for overcoming the memory wall in ANNS. However, its reuse of the system DDR bus prevents the CPU and PIM cores from accessing memory simultaneously. This necessitates batch scheduling in existing systems, which, in turn, leads to severe underutilization in two scenarios: (1) inter-batch, where PIM remains idle while the CPU is copying data, and (2) intra-batch, caused by uneven load distribution of PIM cores in a batch. This article proposes an efficient PIM-capable ANNS system named PIMANN . We observe that each PIM core has an additional, undocumented, and little-known control interface (originally used for control commands like launching PIM kernels), which could be retrofitted for fine-grained arbitration of DDR bus access. Thus, PIMANN can break the traditional batching scheduling paradigm and adopt a fine-grained scheduling paradigm . With this key idea, PIMANN introduces (1) a persistent PIM kernel to eliminate inter-batch idling, (2) per-PU query dispatching to balance real-time load across cores, and (3) microarchitecture-aware per-PU optimization to overcome inherent PU-level hardware constraints. Experiments show that PIMANN can boost throughput by 2.5-11.1× compared to existing ANNS systems on CPU or GPU. The implementation of PIMANN is available at https://github.com/cds-ruc/PIM-ANNS.
Förderung
- Beijing Natural Science Foundation
- National Natural Science Foundation of China
- PCL-CMCC Foundation for Science and Innovation
Zitieren
APA
Wu, P., Xie, M., Zhao, E., Zhang, D., Wang, J., Liang, X., Ren, K., & Chai, Y. (2026). Unlocking PIM-Core Capabilities for Efficient ANNS on Commodity Processing-in-Memory Hardware. ACM Transactions on Storage, 22(3), 1-39. https://doi.org/10.1145/3806055
Vancouver
Wu P, Xie M, Zhao E, Zhang D, Wang J, Liang X, et al. Unlocking PIM-Core Capabilities for Efficient ANNS on Commodity Processing-in-Memory Hardware. ACM Transactions on Storage. 2026;22(3):1-39. doi:10.1145/3806055
BibTeX
@article{Wu2026,
author = {Wu, Puqing and Xie, Minhui and Zhao, Enrui and Zhang, Dafang and Wang, Jing and Liang, Xiao and Ren, Kai and Chai, Yunpeng},
title = {Unlocking PIM-Core Capabilities for Efficient ANNS on Commodity Processing-in-Memory Hardware},
journal = {ACM Transactions on Storage},
year = {2026},
volume = {22},
number = {3},
pages = {1--39},
doi = {10.1145/3806055}
}
EUVIMED