EUVIMEDAvasta EUVIMED
Open access · CC BY 4.0

Autonomous navigation in realistic urban environments using machine learning and path planning

Gonçalo Penelas, Tiago Pinto, Luís Barbosa, Arsénio Reis, João Barroso

Journal of Convex Analysis · 2027 · 34 (1) · 458-470

DOI: 10.68381/jca34031 ↗

At a glance

Journal article in Journal of Convex Analysis, 2027. Written by Gonçalo Penelas and 4 co-authors. 35 references. The full text is freely available (open access, CC BY 4.0).

AbstraktBibliograafilised andmedCiteRelated studies

Abstract (original language)

Deep Reinforcement Learning (DRL) has achieved remarkable results in simulated environments for its ability to learn optimal actions through interaction. Yet, applying these techniques to complex urban contexts remains challenging due to the need for efficient exploration and adaptive decision-making. This work applies DRL to autonomous navigation in a realistic simulated environment based on Vila Real, Portugal, comparing the Proximal Policy Optimization (PPO) and Soft Actor-Critic (SAC) algorithms. Alongside their implementation, the mathematical principles underlying both methods are examined to clarify their learning dynamics. The PPO agent achieved a best cumulative reward of 69.37 after 150 million training steps (66.1 hours), while SAC obtained -7.91 after 182.7 hours, showing limited performance. These results demonstrate the effectiveness of PPO-based DRL for autonomous navigation in complex urban environments.

Cite

APA

Penelas, G., Pinto, T., Barbosa, L., Reis, A., & Barroso, J. (2027). Autonomous navigation in realistic urban environments using machine learning and path planning. Journal of Convex Analysis, 34(1), 458-470. https://doi.org/10.68381/jca34031

Vancouver

Penelas G, Pinto T, Barbosa L, Reis A, Barroso J. Autonomous navigation in realistic urban environments using machine learning and path planning. Journal of Convex Analysis. 2027;34(1):458-470. doi:10.68381/jca34031

BibTeX
@article{Penelas2027,
  author = {Penelas, Gonçalo and Pinto, Tiago and Barbosa, Luís and Reis, Arsénio and Barroso, João},
  title = {Autonomous navigation in realistic urban environments using machine learning and path planning},
  journal = {Journal of Convex Analysis},
  year = {2027},
  volume = {34},
  number = {1},
  pages = {458--470},
  doi = {10.68381/jca34031}
}
Start for free →