EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Shared visuo-tactile interactive perception for robust object pose estimation

Prajval Kumar Murali, Bernd Porr, Mohsen Kaboli

The International Journal of Robotics Research · 2025-06 · 44 (7) · 1186-1216

DOI: 10.1177/02783649241301443 ↗

Kurz gefasst

Fachartikel in der Zeitschrift The International Journal of Robotics Research, online erschienen am 18.12.2024. Verfasst von Prajval Kumar Murali und 2 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 122 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Bayerische Motoren Werke, EU Horizon Project PHASTRAC.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Shared perception between robotic systems significantly enhances their ability to understand and interact with their environment, leading to improved performance and efficiency in various applications. In this work, we present a novel full-fledged framework for robotic systems to interactively share their visuo-tactile perception for the robust pose estimation of novel objects in dense clutter. This is demonstrated with a two-robot team sharing their visuo-tactile scene representation which then declutters the scene using interactive perception and precisely estimates the 6 Degrees-of-Freedom (DoF) pose and 3 DoF scale of a target unknown object. This is achieved with the Stochastic Translation-Invariant Quaternion Filter (S-TIQF), a novel Bayesian filtering method with robust stochastic optimization for estimating the globally optimal pose of a target object. S-TIQF is also deployed to perform in situ visuo-tactile hand-eye calibration, since shared perception requires accurate extrinsic calibration between the two different sensing modalities, tactile and visual. Finally, we develop a novel active shared visuo-tactile representation and object reconstruction method employing a joint information gain criterion to improve the sample efficiency of the robot actions. To validate the effectiveness of our approach, we perform extensive experiments across standard datasets for pose estimation, as well as real-robot experiments with opaque, transparent and specular objects in randomised clutter settings and comprehensive comparison with other state-of-the-art approaches. Our experiments indicate that our approach outperforms state-of-the-art methods in terms of pose estimation accuracy for dense visual and sparse tactile point clouds.

Förderung

  • Bayerische Motoren Werke
  • EU Horizon Project PHASTRAC

Zitieren

APA

Murali, P. K., Porr, B., & Kaboli, M. (2025). Shared visuo-tactile interactive perception for robust object pose estimation. The International Journal of Robotics Research, 44(7), 1186-1216. https://doi.org/10.1177/02783649241301443

Vancouver

Murali PK, Porr B, Kaboli M. Shared visuo-tactile interactive perception for robust object pose estimation. The International Journal of Robotics Research. 2025;44(7):1186-1216. doi:10.1177/02783649241301443

BibTeX
@article{Murali2025,
  author = {Murali, Prajval Kumar and Porr, Bernd and Kaboli, Mohsen},
  title = {Shared visuo-tactile interactive perception for robust object pose estimation},
  journal = {The International Journal of Robotics Research},
  year = {2025},
  volume = {44},
  number = {7},
  pages = {1186--1216},
  doi = {10.1177/02783649241301443}
}
Kostenlos starten →