EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Risk-Aware Deep Reinforcement Learning for Robot Crowd Navigation

Xueying Sun, Qiang Zhang, Yifei Wei, Mingmin Liu

Electronics · 22.11.2023 · 12 (23) · 4744

DOI: 10.3390/electronics12234744 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Electronics, online erschienen am 22.11.2023. Verfasst von Xueying Sun und 3 weiteren Autor:innen. Die Arbeit wurde bisher 25-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Jiangsu Province’s “Double Innovation Plan”.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Ensuring safe and efficient navigation in crowded environments is a critical goal for assistive robots. Recent studies have emphasized the potential of deep reinforcement learning techniques to enhance robots’ navigation capabilities in the presence of crowds. However, current deep reinforcement learning methods often face the challenge of robots freezing as crowd density increases. To address this issue, a novel risk-aware deep reinforcement learning approach is proposed in this paper. The proposed method integrates a risk function to assess the probability of collision between the robot and pedestrians, enabling the robot to proactively prioritize pedestrians with a higher risk of collision. Furthermore, the model dynamically adjusts the fusion strategy of learning-based and risk-aware-based features, thereby improving the robustness of robot navigation. Evaluations were conducted to determine the effectiveness of the proposed method in both low- and high-crowd density settings. The results exhibited remarkable navigation success rates of 98.0% and 93.2% in environments with 10 and 20 pedestrians, respectively. These findings emphasize the robust performance of the proposed method in successfully navigating through crowded spaces. Additionally, the approach achieves navigation times comparable to those of state-of-the-art methods, confirming its efficiency in accomplishing navigation tasks. The generalization capability of the method was also rigorously assessed by subjecting it to testing in crowd environments exceeding the training density. Notably, the proposed method attains an impressive navigation success rate of 90.0% in 25-person environments, surpassing the performance of existing approaches and establishing itself as a state-of-the-art solution. This result highlights the versatility and effectiveness of the proposed method in adapting to various crowd densities and further reinforces its applicability in real-world scenarios.

Förderung

  • National Natural Science Foundation of China
  • Jiangsu Province’s “Double Innovation Plan”

Zitieren

APA

Sun, X., Zhang, Q., Wei, Y., & Liu, M. (2023). Risk-Aware Deep Reinforcement Learning for Robot Crowd Navigation. Electronics, 12(23), 4744. https://doi.org/10.3390/electronics12234744

Vancouver

Sun X, Zhang Q, Wei Y, Liu M. Risk-Aware Deep Reinforcement Learning for Robot Crowd Navigation. Electronics. 2023;12(23):4744. doi:10.3390/electronics12234744

BibTeX
@article{Sun2023,
  author = {Sun, Xueying and Zhang, Qiang and Wei, Yifei and Liu, Mingmin},
  title = {Risk-Aware Deep Reinforcement Learning for Robot Crowd Navigation},
  journal = {Electronics},
  year = {2023},
  volume = {12},
  number = {23},
  pages = {4744},
  doi = {10.3390/electronics12234744}
}
Infokarte | EUVIMED

Artikeldaten derzeit nicht verfügbar.

Recherche