EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-SA 4.0

Pressure-Guided Q-Learning: a warm-started hybrid controller for signalised urban grids

Advik Singh

Journal of High School Science · 14.07.2026 · 10 (3)

DOI: 10.64336/001c.165084 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of High School Science, online erschienen am 14.07.2026. Verfasst von Advik Singh. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-SA 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study compares five traffic-signal controllers on a 3×3 SUMO grid and validates the principal findings on a 5×5 grid. The controllers are fixed-time, gap-out actuated, max-pressure, independent tabular Q-learning, and a new hybrid called Pressure-Guided Q-Learning (PGQL). PGQL augments a Q-learner with three actions (hold, follow max-pressure, override max-pressure) and warm-starts the Q-table so the untrained agent initially behaves like max-pressure while learning state-dependent deviations. On the 3×3 grid, the pressure-aware controllers reduced mean waiting time (MWT) by about threefold relative to fixed-time at moderate load. Relative to max-pressure, PGQL was worse at low load, tied near saturation, and better post-saturation. On the 5×5 grid, PGQL outperformed max-pressure at every tested load by up to 6.6%. An action audit showed that learned overrides increased from 28% at low load to 37% under saturation. An ablation replacing max-pressure with gap-out actuation as the warm-start reduced post-saturation performance by about 12%, demonstrating that the choice of warm-start expert matters. Cold-start experiments showed that warm-start primarily improves initialization safety rather than final low-load performance. Plotting MWT against the mean number of vehicles in the network, rather than offered demand, avoids a post-saturation measurement artefact and supports an M/M/1-style carrying-capacity model with a single physically meaningful capacity parameter. The results show that classical adaptive control and reinforcement learning can be combined to achieve measurable post-saturation improvements while retaining max-pressure behavior at initialization, although its formal stability proof does not extend to the learned policy.

Zitieren

APA

Singh, A. (2026). Pressure-Guided Q-Learning: a warm-started hybrid controller for signalised urban grids. Journal of High School Science, 10(3). https://doi.org/10.64336/001c.165084

Vancouver

Singh A. Pressure-Guided Q-Learning: a warm-started hybrid controller for signalised urban grids. Journal of High School Science. 2026;10(3). doi:10.64336/001c.165084

BibTeX
@article{Singh2026,
  author = {Singh, Advik},
  title = {Pressure-Guided Q-Learning: a warm-started hybrid controller for signalised urban grids},
  journal = {Journal of High School Science},
  year = {2026},
  volume = {10},
  number = {3},
  doi = {10.64336/001c.165084}
}
Kostenlos starten →