Pressure-Guided Q-Learning: a warm-started hybrid controller for signalised urban grids
Journal of High School Science · 14.07.2026 · 10 (3)
DOI: 10.64336/001c.165084 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of High School Science, online erschienen am 14.07.2026. Verfasst von Advik Singh. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-SA 4.0).
Abstract (Originalsprache)
This study compares five traffic-signal controllers on a 3×3 SUMO grid and validates the principal findings on a 5×5 grid. The controllers are fixed-time, gap-out actuated, max-pressure, independent tabular Q-learning, and a new hybrid called Pressure-Guided Q-Learning (PGQL). PGQL augments a Q-learner with three actions (hold, follow max-pressure, override max-pressure) and warm-starts the Q-table so the untrained agent initially behaves like max-pressure while learning state-dependent deviations. On the 3×3 grid, the pressure-aware controllers reduced mean waiting time (MWT) by about threefold relative to fixed-time at moderate load. Relative to max-pressure, PGQL was worse at low load, tied near saturation, and better post-saturation. On the 5×5 grid, PGQL outperformed max-pressure at every tested load by up to 6.6%. An action audit showed that learned overrides increased from 28% at low load to 37% under saturation. An ablation replacing max-pressure with gap-out actuation as the warm-start reduced post-saturation performance by about 12%, demonstrating that the choice of warm-start expert matters. Cold-start experiments showed that warm-start primarily improves initialization safety rather than final low-load performance. Plotting MWT against the mean number of vehicles in the network, rather than offered demand, avoids a post-saturation measurement artefact and supports an M/M/1-style carrying-capacity model with a single physically meaningful capacity parameter. The results show that classical adaptive control and reinforcement learning can be combined to achieve measurable post-saturation improvements while retaining max-pressure behavior at initialization, although its formal stability proof does not extend to the learned policy.
Zitieren
APA
Singh, A. (2026). Pressure-Guided Q-Learning: a warm-started hybrid controller for signalised urban grids. Journal of High School Science, 10(3). https://doi.org/10.64336/001c.165084
Vancouver
Singh A. Pressure-Guided Q-Learning: a warm-started hybrid controller for signalised urban grids. Journal of High School Science. 2026;10(3). doi:10.64336/001c.165084
BibTeX
@article{Singh2026,
author = {Singh, Advik},
title = {Pressure-Guided Q-Learning: a warm-started hybrid controller for signalised urban grids},
journal = {Journal of High School Science},
year = {2026},
volume = {10},
number = {3},
doi = {10.64336/001c.165084}
}
EUVIMED