EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A multi-user multi-robot multi-goal multi-device human-robot interaction manipulation benchmark

Akito Yoshida, Rousslan Fernand Julien Dossa, Marina Di Vincenzo, Shivakanth Sujit, Hannah Douglas, Kai Arulkumaran

Frontiers in Robotics and AI · 25.09.2025 · 12

DOI: 10.3389/frobt.2025.1528754 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Frontiers in Robotics and AI, online erschienen am 25.09.2025. Verfasst von Akito Yoshida und 5 weiteren Autor:innen. Beteiligte Einrichtung: Araya Inc., Tokyo, Japan. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 62 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Moonshot Research and Development Program.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

One weakness of human-robot interaction (HRI) research is the lack of reproducible results, due to the lack of standardised benchmarks. In this work we introduce a multi-user multi-robot multi-goal multi-device manipulation benchmark (M4Bench), a flexible HRI platform in which multiple users can direct either a single—or multiple—simulated robots to perform a multi-goal pick-and-place task. Our software exposes a web-based visual interface, with support for mouse, keyboard, gamepad, eye tracker and electromyograph/electroencephalograph (EMG/EEG) user inputs. It can be further extended using native browser libraries or WebSocket interfaces, allowing researchers to add support for their own devices. We also provide tracking for several HRI metrics, such as task completion and command selection time, enabling quantitative comparisons between different user interfaces and devices. We demonstrate the utility of our benchmark with a user study (n = 50) conducted to compare five different input devices, and also compare single-vs. multi-user control. In the pick-and-place task, we found that users performed worse when using the eye tracker + EMG device pair, as compared to mouse + keyboard or gamepad + gamepad, over four quantitative metrics (corrected p < 0.001). Our software is available at https://github.com/arayabrain/m4bench .

Schlagwörter

Stichwörter der Autor:innen

benchmarkhuman-robot interactionmulti-agentmultimodalshared autonomy

Autor:innen und Institutionen

  • Araya Inc., Tokyo, Japan.

Förderung

  • Moonshot Research and Development Program

Zitieren

APA

Yoshida, A., Dossa, R. F. J., Di Vincenzo, M., Sujit, S., Douglas, H., & Arulkumaran, K. (2025). A multi-user multi-robot multi-goal multi-device human-robot interaction manipulation benchmark. Frontiers in Robotics and AI, 12. https://doi.org/10.3389/frobt.2025.1528754

Vancouver

Yoshida A, Dossa RFJ, Di Vincenzo M, Sujit S, Douglas H, Arulkumaran K. A multi-user multi-robot multi-goal multi-device human-robot interaction manipulation benchmark. Frontiers in Robotics and AI. 2025;12. doi:10.3389/frobt.2025.1528754

BibTeX
@article{Yoshida2025,
  author = {Yoshida, Akito and Dossa, Rousslan Fernand Julien and Di Vincenzo, Marina and Sujit, Shivakanth and Douglas, Hannah and Arulkumaran, Kai},
  title = {A multi-user multi-robot multi-goal multi-device human-robot interaction manipulation benchmark},
  journal = {Frontiers in Robotics and AI},
  year = {2025},
  volume = {12},
  doi = {10.3389/frobt.2025.1528754}
}
Kostenlos starten →