Fainder: A Fast and Accurate Index for Distribution-Aware Dataset Search
Proceedings of the VLDB Endowment · 2024-07 · 17 (11) · 3269-3282
DOI: 10.14778/3681954.3681999 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the VLDB Endowment, online erschienen am 30.08.2024. Verfasst von Lennart Behme und 3 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 63 Literaturangaben.
Abstract (Originalsprache)
Efficient data discovery is crucial in the era of data-driven decisionmaking. However, current practices face significant challenges due to the intricacies of identifying datasets with specific distributional characteristics, such as percentiles, when data repositories are decentralized. Traditional keyword-based search methods are insufficient for these complex requirements, often resulting in suboptimal dataset search results. To address these challenges, this paper presents Fainder, a fast and accurate index for "percentile predicates" on histogram-based data summaries, which streamlines the search process for datasets with specific distributional requirements. Fainder can be constructed on heterogeneous histogram collections and employs binary search in conjunction with multi-step pruning techniques to efficiently identify search results for percentile predicates. Thereby, it simplifies data provisioning and improves the effectiveness of dataset discovery. Empirical evaluation of our solution on three large-scale data repositories shows that Fainder is effective for distribution-aware dataset search and provides order-of-magnitude efficiency gains over baselines.
Zitieren
APA
Behme, L., Galhotra, S., Beedkar, K., & Markl, V. (2024). Fainder: A Fast and Accurate Index for Distribution-Aware Dataset Search. Proceedings of the VLDB Endowment, 17(11), 3269-3282. https://doi.org/10.14778/3681954.3681999
Vancouver
Behme L, Galhotra S, Beedkar K, Markl V. Fainder: A Fast and Accurate Index for Distribution-Aware Dataset Search. Proceedings of the VLDB Endowment. 2024;17(11):3269-3282. doi:10.14778/3681954.3681999
BibTeX
@article{Behme2024,
author = {Behme, Lennart and Galhotra, Sainyam and Beedkar, Kaustubh and Markl, Volker},
title = {Fainder: A Fast and Accurate Index for Distribution-Aware Dataset Search},
journal = {Proceedings of the VLDB Endowment},
year = {2024},
volume = {17},
number = {11},
pages = {3269--3282},
doi = {10.14778/3681954.3681999}
}
EUVIMED