EUVIMEDEUVIMED entdecken
Crossref

Filtering and Accelerating: A Unified Framework for High-Performance Persistence Estimation

Qilong Shi, Lu Cao, Weiqiang Xiao, Nianfu Wang, Wenjun Li, Tong Yang, Zhijun Li, Weizhe Zhang, Mingwei Xu

IEEE Transactions on Knowledge and Data Engineering · 2026-08 · 38 (8) · 5095-5112

DOI: 10.1109/tkde.2026.3695579 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Knowledge and Data Engineering, 2026-08. Verfasst von Qilong Shi und 8 weiteren Autor:innen. Die Arbeit nennt 60 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Efficient data stream processing, particularly for persistence estimation, is crucial in handling high-velocity data streams characterized by skewed distributions of item frequencies. Unlike more straightforward frequency metrics, persistence captures items’ recurrence across multiple time windows, posing a significant challenge to existing single-structure sketches where high-persistence and low-persistence items collide. To address this, we introduce the Hypersistent Sketch, a unified framework for high-performance estimation built on two decoupled mechanisms: filtering and accelerating. The filtering component, a Cold Filter, directly addresses the skewed nature of data streams. It separates hot items from the majority of cold ones, which allows for differential treatment. The accelerating component, a Burst Filter, then optimizes the processing of hot items. It significantly improves throughput by preventing repeated insertions within a single window. We demonstrate its generality by applying it to various state-of-the-art sketches (e.g., On-Off, Waving, P-Sketch), showing it consistently enhances their original performance. We also deploy our framework on Redis platforms, demonstrating the framework’s broad applicability and scalability.

Zitieren

APA

Shi, Q., Cao, L., Xiao, W., Wang, N., Li, W., Yang, T., Li, Z., Zhang, W., & Xu, M. (2026). Filtering and Accelerating: A Unified Framework for High-Performance Persistence Estimation. IEEE Transactions on Knowledge and Data Engineering, 38(8), 5095-5112. https://doi.org/10.1109/tkde.2026.3695579

Vancouver

Shi Q, Cao L, Xiao W, Wang N, Li W, Yang T, et al. Filtering and Accelerating: A Unified Framework for High-Performance Persistence Estimation. IEEE Transactions on Knowledge and Data Engineering. 2026;38(8):5095-5112. doi:10.1109/tkde.2026.3695579

BibTeX
@article{Shi2026,
  author = {Shi, Qilong and Cao, Lu and Xiao, Weiqiang and Wang, Nianfu and Li, Wenjun and Yang, Tong and Li, Zhijun and Zhang, Weizhe and Xu, Mingwei},
  title = {Filtering and Accelerating: A Unified Framework for High-Performance Persistence Estimation},
  journal = {IEEE Transactions on Knowledge and Data Engineering},
  year = {2026},
  volume = {38},
  number = {8},
  pages = {5095--5112},
  doi = {10.1109/tkde.2026.3695579}
}
Kostenlos starten →