EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Follower-Aware Reward Shaping for Leader–Follower Formation Control via Dueling Deep Q-Networks

Natasha Araújo Caxias, Abel Severo Rocha, José Reginaldo Hughes Carvalho

Revista Eletrônica de Iniciação Científica em Computação · 10.07.2026 · 24 · 529-536

DOI: 10.5753/reic.2026.8466 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Revista Eletrônica de Iniciação Científica em Computação, online erschienen am 10.07.2026. Verfasst von Natasha Araújo Caxias und 2 weiteren Autor:innen. Die Arbeit nennt 18 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This paper proposes a follower-aware reward shaping strategy for leader–follower formation control of non-holonomic mobile robots, implemented within a hybrid Dueling Deep Q-Network (Dueling DQN) architecture. The leader employs a Dueling DQN enhanced with Prioritized Experience Replay, Frame Stacking, and a novel follower-aware safety penalty trained under a Curriculum Learning regime with progressive Domain Randomization. The follower tracks a virtual target located behind the leader using a proportional–derivative controller, thereby decoupling computational complexity between the agents. Validated in an 8 × 8 m environment featuring a 2.0 m inner gap and a 1.0 m lateral exit door (dcollision = 0.50 m), the proposed system achieves 100% success across three fixed-geometry configurations (500 episodes each) and 74.0% in a procedural generalization test with randomized obstacle placement. Comprehensive ablation studies confirm that the follower-aware reward shaping strategy is the single most impactful component, outweighing established techniques such as Prioritized Experience Replay and dueling decomposition. The findings provide empirical evidence that explicitly encoding cooperative safety constraints into the leader’s policy yields emergent path-planning behaviors that account for the follower’s kinematic limitations, offering a practical pathway toward robust multi-robot coordination in cluttered environments.

Zitieren

APA

Caxias, N. A., Rocha, A. S., & Carvalho, J. R. H. (2026). Follower-Aware Reward Shaping for Leader–Follower Formation Control via Dueling Deep Q-Networks. Revista Eletrônica de Iniciação Científica em Computação, 24, 529-536. https://doi.org/10.5753/reic.2026.8466

Vancouver

Caxias NA, Rocha AS, Carvalho JRH. Follower-Aware Reward Shaping for Leader–Follower Formation Control via Dueling Deep Q-Networks. Revista Eletrônica de Iniciação Científica em Computação. 2026;24:529-536. doi:10.5753/reic.2026.8466

BibTeX
@article{Caxias2026,
  author = {Caxias, Natasha Araújo and Rocha, Abel Severo and Carvalho, José Reginaldo Hughes},
  title = {Follower-Aware Reward Shaping for Leader–Follower Formation Control via Dueling Deep Q-Networks},
  journal = {Revista Eletrônica de Iniciação Científica em Computação},
  year = {2026},
  volume = {24},
  pages = {529--536},
  doi = {10.5753/reic.2026.8466}
}
Kostenlos starten →