NeurBench: A Benchmark Suite for Learned Database Components with Drift Modeling: [Experiments & Analysis]
Proceedings of the ACM on Management of Data · 2026-05-18 · 4 (3) · 1-27
DOI: 10.1145/3802091 ↗At a glance
Journal article in Proceedings of the ACM on Management of Data, published online on 2026-05-18. Written by Zhanhao Zhao and 7 co-authors. 71 references.
Abstract (original language)
Learned database components, which deeply integrate machine learning into their design, have been extensively studied in recent years. Given the dynamism of databases, where data and workloads continuously drift, it is crucial for learned database components to remain effective and efficient in the face of data and workload drift. Robustness, therefore, is a key factor in assessing their practical applicability. Although recent works examine learned database components under specific drift, they fail to enable systematic performance evaluations across a broad range of drift or under customized drift as needed. This paper presents NeurBench, a new benchmark suite that supports evaluating learned database components under measurable and controllable data and workload drift. We quantify diverse types of drift by introducing a key concept called the drift factor. Building on this formulation, we propose a drift-aware data and workload generation framework that effectively simulates real-world drift while preserving inherent correlations. Experimental results demonstrate the effectiveness of NeurBench in generating realistic data and workload drift, while providing insights into the performance of representative learned database components under different drift scenarios.
Cite
APA
Zhao, Z., Gao, H., Xing, N., Zeng, L., Zhang, M., Chen, G., Rigger, M., & Ooi, B. C. (2026). NeurBench: A Benchmark Suite for Learned Database Components with Drift Modeling: [Experiments & Analysis]. Proceedings of the ACM on Management of Data, 4(3), 1-27. https://doi.org/10.1145/3802091
Vancouver
Zhao Z, Gao H, Xing N, Zeng L, Zhang M, Chen G, et al. NeurBench: A Benchmark Suite for Learned Database Components with Drift Modeling: [Experiments & Analysis]. Proceedings of the ACM on Management of Data. 2026;4(3):1-27. doi:10.1145/3802091
BibTeX
@article{Zhao2026,
author = {Zhao, Zhanhao and Gao, Haotian and Xing, Naili and Zeng, Lingze and Zhang, Meihui and Chen, Gang and Rigger, Manuel and Ooi, Beng Chin},
title = {NeurBench: A Benchmark Suite for Learned Database Components with Drift Modeling: [Experiments & Analysis]},
journal = {Proceedings of the ACM on Management of Data},
year = {2026},
volume = {4},
number = {3},
pages = {1--27},
doi = {10.1145/3802091}
}
EUVIMED