EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Transition‐Aware Q‐Learning for Robust Tracking in Networked Control Systems with Fading Channels: Application to Leader−Follower Vehicle Control

Ehsan Badfar, Babak Tavassoli

IET Control Theory & Applications · 2026-01 · 20 (1)

DOI: 10.1049/cth2.70127 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IET Control Theory & Applications, online erschienen am 27.05.2026. Verfasst von Ehsan Badfar und 1 weiteren Autor:innen. Die Arbeit nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In various industrial domains, such as intelligent transportation systems, maintaining accurate tracking performance in networked control systems (NCS) operating over fading wireless channels remains a critical challenge. The fundamental difficulty arises from the stochastic and temporally correlated nature of wireless links, which limits the effectiveness of existing control strategies. To address this problem, we introduce a transition‐aware Q‐learning (TA‐QL) framework that enables model‐free robust tracking control of NCS subject to fading‐induced uncertainties. The proposed approach learns optimal policies directly from networked data while preserving the Markovian dependencies among network states, without requiring explicit models or solving coupled algebraic Riccati equations. We rigorously prove that the learned policies ensure mean‐square stability and satisfy the disturbance attenuation criterion. Extensive simulations on a leader–follower vehicle spacing control scenario over realistic 5G fading channels validate the effectiveness of TA‐QL. Compared with baseline schemes, including subsystem transformation‐based approach, TA‐QL improves convergence rate and data efficiency by approximately 54%. Overall, the proposed method bridges robust control and data‐driven learning, offering a practical solution for industrial applications of NCS.

Zitieren

APA

Badfar, E., & Tavassoli, B. (2026). Transition‐Aware Q‐Learning for Robust Tracking in Networked Control Systems with Fading Channels: Application to Leader−Follower Vehicle Control. IET Control Theory & Applications, 20(1). https://doi.org/10.1049/cth2.70127

Vancouver

Badfar E, Tavassoli B. Transition‐Aware Q‐Learning for Robust Tracking in Networked Control Systems with Fading Channels: Application to Leader−Follower Vehicle Control. IET Control Theory & Applications. 2026;20(1). doi:10.1049/cth2.70127

BibTeX
@article{Badfar2026,
  author = {Badfar, Ehsan and Tavassoli, Babak},
  title = {Transition‐Aware Q‐Learning for Robust Tracking in Networked Control Systems with Fading Channels: Application to Leader−Follower Vehicle Control},
  journal = {IET Control Theory & Applications},
  year = {2026},
  volume = {20},
  number = {1},
  doi = {10.1049/cth2.70127}
}
Kostenlos starten →