EUVIMEDEUVIMED entdecken
LeitlinieOpen Access · CC BY 4.0

Principles and Guidelines for Evaluating Social Robot Navigation Algorithms

Anthony Francis, Claudia Pérez-D’Arpino, Chengshu Li, Fei Xia, Alexandre Alahi, Rachid Alami, Aniket Bera, Abhijat Biswas, Joydeep Biswas, Rohan Chandra, Hao-Tien Lewis Chiang, Michael Everett und 19 weitere

ACM Transactions on Human-Robot Interaction · 30.06.2025 · 14 (2) · 1-65

DOI: 10.1145/3700599 ↗

Kurz gefasst

Leitlinie in der Zeitschrift ACM Transactions on Human-Robot Interaction, online erschienen am 20.02.2025. Verfasst von Anthony Francis und 30 weiteren Autor:innen. Die Arbeit wurde bisher 96-mal zitiert (Crossref) und nennt 172 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

A major challenge to deploying robots widely is navigation in human-populated environments, commonly referred to as social robot navigation . While the field of social navigation has advanced tremendously in recent years, the fair evaluation of algorithms that tackle social navigation remains hard because it involves not just robotic agents moving in static environments but also dynamic human agents and their perceptions of the appropriateness of robot behavior. In contrast, clear, repeatable, and accessible benchmarks have accelerated progress in fields like computer vision, natural language processing and traditional robot navigation by enabling researchers to fairly compare algorithms, revealing limitations of existing solutions and illuminating promising new directions. We believe the same approach can benefit social navigation. In this article, we pave the road toward common, widely accessible, and repeatable benchmarking criteria to evaluate social robot navigation. Our contributions include (a) a definition of a socially navigating robot as one that respects the principles of safety, comfort, legibility, politeness, social competency, agent understanding, proactivity, and responsiveness to context, (b) guidelines for the use of metrics, development of scenarios, benchmarks, datasets, and simulators to evaluate social navigation, and (c) a design of a social navigation metrics framework to make it easier to compare results from different simulators, robots, and datasets.

Zitieren

APA

Francis, A., Pérez-D’Arpino, C., Li, C., Xia, F., Alahi, A., Alami, R., Bera, A., Biswas, A., Biswas, J., Chandra, R., Chiang, H. L., Everett, M., Ha, S., Hart, J., How, J. P., Karnan, H., Lee, T. E., Manso, L. J., Mirsky, R., …, & Martín-Martín, R. (2025). Principles and Guidelines for Evaluating Social Robot Navigation Algorithms. ACM Transactions on Human-Robot Interaction, 14(2), 1-65. https://doi.org/10.1145/3700599

Vancouver

Francis A, Pérez-D’Arpino C, Li C, Xia F, Alahi A, Alami R, et al. Principles and Guidelines for Evaluating Social Robot Navigation Algorithms. ACM Transactions on Human-Robot Interaction. 2025;14(2):1-65. doi:10.1145/3700599

BibTeX
@article{Francis2025,
  author = {Francis, Anthony and Pérez-D’Arpino, Claudia and Li, Chengshu and Xia, Fei and Alahi, Alexandre and Alami, Rachid and Bera, Aniket and Biswas, Abhijat and Biswas, Joydeep and Chandra, Rohan and Chiang, Hao-Tien Lewis and Everett, Michael and Ha, Sehoon and Hart, Justin and How, Jonathan P. and Karnan, Haresh and Lee, Tsang-Wei Edward and Manso, Luis J. and Mirsky, Reuth and Pirk, Sören and Singamaneni, Phani Teja and Stone, Peter and Taylor, Ada V. and Trautman, Peter and Tsoi, Nathan and Vázquez, Marynel and Xiao, Xuesu and Xu, Peng and Yokoyama, Naoki and Toshev, Alexander and Martín-Martín, Roberto},
  title = {Principles and Guidelines for Evaluating Social Robot Navigation Algorithms},
  journal = {ACM Transactions on Human-Robot Interaction},
  year = {2025},
  volume = {14},
  number = {2},
  pages = {1--65},
  doi = {10.1145/3700599}
}
Kostenlos starten →