Synchronizing Disaggregated Data Structures with One-Sided RDMA: Pitfalls, Experiments and Design Guidelines
ACM Transactions on Database Systems · 31.03.2025 · 50 (1) · 1-40
DOI: 10.1145/3716377 ↗Kurz gefasst
Leitlinie in der Zeitschrift ACM Transactions on Database Systems, online erschienen am 06.03.2025. Verfasst von Matthias Jasny und 4 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 74 Literaturangaben. Gefördert von: German Research Foundation priority program 2037, DFG Collaborative Research Center 1053.
Abstract (Originalsprache)
Remote data structures built with one-sided Remote Direct Memory Access (RDMA) are at the heart of many disaggregated database management systems today. Concurrent access to these data structures by thousands of remote workers necessitates a highly efficient synchronization scheme. Remarkably, our investigation reveals that existing synchronization schemes display substantial variations in performance and scalability. Even worse, some schemes do not correctly synchronize, resulting in rare and hard-to-detect data corruption. Motivated by these observations, we conduct the first comprehensive analysis of one-sided synchronization techniques and provide general principles for correct synchronization using one-sided RDMA. Our research demonstrates that adherence to these principles not only guarantees correctness but also results in substantial performance enhancements. This article is an extended version of [ 72 ] in which we investigate modern 400G NICs. Our findings reveal that the challenges persist even with new generations of NICs. Consequently, we turn our attention to alternative networking hardware, such as smart switches, to address some of the limitations associated with one-sided synchronization.
Förderung
- German Research Foundation priority program 2037
- DFG Collaborative Research Center 1053
Zitieren
APA
Jasny, M., Ziegler, T., Nelson-Slivon, J., Leis, V., & Binnig, C. (2025). Synchronizing Disaggregated Data Structures with One-Sided RDMA: Pitfalls, Experiments and Design Guidelines. ACM Transactions on Database Systems, 50(1), 1-40. https://doi.org/10.1145/3716377
Vancouver
Jasny M, Ziegler T, Nelson-Slivon J, Leis V, Binnig C. Synchronizing Disaggregated Data Structures with One-Sided RDMA: Pitfalls, Experiments and Design Guidelines. ACM Transactions on Database Systems. 2025;50(1):1-40. doi:10.1145/3716377
BibTeX
@article{Jasny2025,
author = {Jasny, Matthias and Ziegler, Tobias and Nelson-Slivon, Jacob and Leis, Viktor and Binnig, Carsten},
title = {Synchronizing Disaggregated Data Structures with One-Sided RDMA: Pitfalls, Experiments and Design Guidelines},
journal = {ACM Transactions on Database Systems},
year = {2025},
volume = {50},
number = {1},
pages = {1--40},
doi = {10.1145/3716377}
}
EUVIMED