Human-Assisted Deep Reinforcement Learning (HADRL) for Multi-Objective Tram Optimisation Problem
Applied Sciences · 09.04.2026 · 16 (8) · 3683
DOI: 10.3390/app16083683 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 09.04.2026. Verfasst von Moneeb Ashraf und 2 weiteren Autor:innen. Die Arbeit nennt 27 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Reducing traction energy in urban rail systems while preserving safety, punctuality, and passenger comfort remains challenging. Additionally, route-level tram studies that train deep reinforcement learning (DRL) policies using Operational Train Monitoring Recorder (OTMR) logs and benchmark them across multiple objectives remain limited. This study develops and evaluates a Human-Assisted Deep Reinforcement Learning (HADRL) framework for multi-objective tram control in an OTMR-grounded simulation. Two HADRL agents were trained using a human-assistance action mapping: a standard Proximal Policy Optimisation (PPO) baseline and a recurrent, history-augmented PPO. Their performance was compared against that of four human drivers using indices for speed-limit compliance, schedule deviation, traction energy, jerk-based comfort, and stopping accuracy. These performance measures were aggregated using the Technique for Order Preference by Similarity to an Ideal Solution (TOPSIS) with both equal and entropy-derived weights. Both HADRL agents reproduce the characteristic accelerate–coast–brake driving pattern, reduce traction energy relative to all human baselines, and achieve near-complete speed-limit compliance, all while remaining within the specified schedule-deviation and comfort thresholds. TOPSIS yields identical rankings under both weighting schemes, with Multi-Objective Tram Operation Non-Stationary Proximal Policy Optimisation (MOTO-NSPPO, a recurrent, history-augmented PPO) ranked first and PPO second.
Zitieren
APA
Ashraf, M., Hillmansen, S., & Zhao, N. (2026). Human-Assisted Deep Reinforcement Learning (HADRL) for Multi-Objective Tram Optimisation Problem. Applied Sciences, 16(8), 3683. https://doi.org/10.3390/app16083683
Vancouver
Ashraf M, Hillmansen S, Zhao N. Human-Assisted Deep Reinforcement Learning (HADRL) for Multi-Objective Tram Optimisation Problem. Applied Sciences. 2026;16(8):3683. doi:10.3390/app16083683
BibTeX
@article{Ashraf2026,
author = {Ashraf, Moneeb and Hillmansen, Stuart and Zhao, Ning},
title = {Human-Assisted Deep Reinforcement Learning (HADRL) for Multi-Objective Tram Optimisation Problem},
journal = {Applied Sciences},
year = {2026},
volume = {16},
number = {8},
pages = {3683},
doi = {10.3390/app16083683}
}
EUVIMED