EUVIMEDEUVIMED entdecken
Crossref

Policy Gradient and Actor-Critic Approaches to Quickest Change Detection

Zhengyan Huan, Xiaodong Wang, Xiao-Yang Liu

IEEE Transactions on Signal Processing · 2026 · 74 · 2550-2563

DOI: 10.1109/tsp.2026.3702905 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Signal Processing, 2026. Verfasst von Zhengyan Huan und 2 weiteren Autor:innen. Die Arbeit nennt 34 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This work builds on the recently proposed end-to-end deep learning approach to quickest change detection (QCD), called DeepQCD, that is based on supervised learning of the binary labels (corresponding to no change or change) associated with the data sample at each time instant. Inspired by the sequential nature of reinforcement learning, our new approach data-driven QCD is to learn a probabilistic policy that maximizes the total reward over a data sample trajectory. Under such a framework, we develop three new deep learning-based QCD algorithms – one policy gradient (PG) QCD algorithm, and two actor-critic (AC) QCD algorithms. These QCD algorithms employ a neural network consisting of recurrent layers that keep an internal state summarizing the time-series data seen so far and update the state as new data sample comes in, and dense layers that map the internal state into a decision probability and/or estimated cumulative reward. Extensive experiments are performed on both synthetic data and real-world data, and the results demonstrate the superior performance of the proposed PG-QCD and AC-QCD methods compared to state-of-the-art learning-based and non-learning-based QCD methods. Moreover, among the three proposed methods, the AC-QCD method that uses a baseline performs the best.

Zitieren

APA

Huan, Z., Wang, X., & Liu, X. (2026). Policy Gradient and Actor-Critic Approaches to Quickest Change Detection. IEEE Transactions on Signal Processing, 74, 2550-2563. https://doi.org/10.1109/tsp.2026.3702905

Vancouver

Huan Z, Wang X, Liu X. Policy Gradient and Actor-Critic Approaches to Quickest Change Detection. IEEE Transactions on Signal Processing. 2026;74:2550-2563. doi:10.1109/tsp.2026.3702905

BibTeX
@article{Huan2026,
  author = {Huan, Zhengyan and Wang, Xiaodong and Liu, Xiao-Yang},
  title = {Policy Gradient and Actor-Critic Approaches to Quickest Change Detection},
  journal = {IEEE Transactions on Signal Processing},
  year = {2026},
  volume = {74},
  pages = {2550--2563},
  doi = {10.1109/tsp.2026.3702905}
}
Kostenlos starten →