Bridging the Gap: Cardinality Estimation for Semantic Queries on Unstructured Data
Proceedings of the ACM on Management of Data · 18.05.2026 · 4 (3) · 1-26
DOI: 10.1145/3802024 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the ACM on Management of Data, online erschienen am 18.05.2026. Verfasst von Shihui Xu und 2 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 52 Literaturangaben. Gefördert von: National Key R&D Program of China, NSF of China.
Abstract (Originalsprache)
Large language models (LLMs) have revolutionized the semantic processing of unstructured data, unlocking new avenues for data analytics beyond traditional relational databases. However, optimizing query execution over unstructured data requires accurate semantic cardinality estimation, a problem that remains unsolved due to the absence of schemas and the high cost of semantic judgments. In this paper, we present SemStats, a framework that efficiently and accurately estimates the number of results for semantic queries. SemStats first constructs a semantic catalog that identifies core semantic dimensions and their relationships within the corpus. Based on the catalog, SemStats then builds a semantic index that constructs the relationships between data points and semantic catalog. As it is expensive to assess the relationships between data points and catalog using LLMs, we propose specialized lightweight models to improve index-construction cost. For online estimation, SemStats employs stratified importance sampling guided by the semantic index and a lightweight judge model to refine query-specific evaluations. Experiments on multiple real-world datasets show that SemStats substantially reduces estimation error (up to 25X) and latency (up to 31X) compared to state-of-the-art baselines, enabling accurate and efficient cardinality estimation of semantic queries on unstructured data.
Förderung
- National Key R&D Program of China
- NSF of China
Zitieren
APA
Xu, S., Wang, J., & Li, G. (2026). Bridging the Gap: Cardinality Estimation for Semantic Queries on Unstructured Data. Proceedings of the ACM on Management of Data, 4(3), 1-26. https://doi.org/10.1145/3802024
Vancouver
Xu S, Wang J, Li G. Bridging the Gap: Cardinality Estimation for Semantic Queries on Unstructured Data. Proceedings of the ACM on Management of Data. 2026;4(3):1-26. doi:10.1145/3802024
BibTeX
@article{Xu2026,
author = {Xu, Shihui and Wang, Jiayi and Li, Guoliang},
title = {Bridging the Gap: Cardinality Estimation for Semantic Queries on Unstructured Data},
journal = {Proceedings of the ACM on Management of Data},
year = {2026},
volume = {4},
number = {3},
pages = {1--26},
doi = {10.1145/3802024}
}
EUVIMED