Follower-Aware Reward Shaping for Leader–Follower Formation Control via Dueling Deep Q-Networks
Revista Eletrônica de Iniciação Científica em Computação · 10.07.2026 · 24 · 529-536
DOI: 10.5753/reic.2026.8466 ↗Kurz gefasst
Fachartikel in der Zeitschrift Revista Eletrônica de Iniciação Científica em Computação, online erschienen am 10.07.2026. Verfasst von Natasha Araújo Caxias und 2 weiteren Autor:innen. Die Arbeit nennt 18 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
This paper proposes a follower-aware reward shaping strategy for leader–follower formation control of non-holonomic mobile robots, implemented within a hybrid Dueling Deep Q-Network (Dueling DQN) architecture. The leader employs a Dueling DQN enhanced with Prioritized Experience Replay, Frame Stacking, and a novel follower-aware safety penalty trained under a Curriculum Learning regime with progressive Domain Randomization. The follower tracks a virtual target located behind the leader using a proportional–derivative controller, thereby decoupling computational complexity between the agents. Validated in an 8 × 8 m environment featuring a 2.0 m inner gap and a 1.0 m lateral exit door (dcollision = 0.50 m), the proposed system achieves 100% success across three fixed-geometry configurations (500 episodes each) and 74.0% in a procedural generalization test with randomized obstacle placement. Comprehensive ablation studies confirm that the follower-aware reward shaping strategy is the single most impactful component, outweighing established techniques such as Prioritized Experience Replay and dueling decomposition. The findings provide empirical evidence that explicitly encoding cooperative safety constraints into the leader’s policy yields emergent path-planning behaviors that account for the follower’s kinematic limitations, offering a practical pathway toward robust multi-robot coordination in cluttered environments.
Zitieren
APA
Caxias, N. A., Rocha, A. S., & Carvalho, J. R. H. (2026). Follower-Aware Reward Shaping for Leader–Follower Formation Control via Dueling Deep Q-Networks. Revista Eletrônica de Iniciação Científica em Computação, 24, 529-536. https://doi.org/10.5753/reic.2026.8466
Vancouver
Caxias NA, Rocha AS, Carvalho JRH. Follower-Aware Reward Shaping for Leader–Follower Formation Control via Dueling Deep Q-Networks. Revista Eletrônica de Iniciação Científica em Computação. 2026;24:529-536. doi:10.5753/reic.2026.8466
BibTeX
@article{Caxias2026,
author = {Caxias, Natasha Araújo and Rocha, Abel Severo and Carvalho, José Reginaldo Hughes},
title = {Follower-Aware Reward Shaping for Leader–Follower Formation Control via Dueling Deep Q-Networks},
journal = {Revista Eletrônica de Iniciação Científica em Computação},
year = {2026},
volume = {24},
pages = {529--536},
doi = {10.5753/reic.2026.8466}
}
EUVIMED