Shared visuo-tactile interactive perception for robust object pose estimation
The International Journal of Robotics Research · 2025-06 · 44 (7) · 1186-1216
DOI: 10.1177/02783649241301443 ↗Kurz gefasst
Fachartikel in der Zeitschrift The International Journal of Robotics Research, online erschienen am 18.12.2024. Verfasst von Prajval Kumar Murali und 2 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 122 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Bayerische Motoren Werke, EU Horizon Project PHASTRAC.
Abstract (Originalsprache)
Shared perception between robotic systems significantly enhances their ability to understand and interact with their environment, leading to improved performance and efficiency in various applications. In this work, we present a novel full-fledged framework for robotic systems to interactively share their visuo-tactile perception for the robust pose estimation of novel objects in dense clutter. This is demonstrated with a two-robot team sharing their visuo-tactile scene representation which then declutters the scene using interactive perception and precisely estimates the 6 Degrees-of-Freedom (DoF) pose and 3 DoF scale of a target unknown object. This is achieved with the Stochastic Translation-Invariant Quaternion Filter (S-TIQF), a novel Bayesian filtering method with robust stochastic optimization for estimating the globally optimal pose of a target object. S-TIQF is also deployed to perform in situ visuo-tactile hand-eye calibration, since shared perception requires accurate extrinsic calibration between the two different sensing modalities, tactile and visual. Finally, we develop a novel active shared visuo-tactile representation and object reconstruction method employing a joint information gain criterion to improve the sample efficiency of the robot actions. To validate the effectiveness of our approach, we perform extensive experiments across standard datasets for pose estimation, as well as real-robot experiments with opaque, transparent and specular objects in randomised clutter settings and comprehensive comparison with other state-of-the-art approaches. Our experiments indicate that our approach outperforms state-of-the-art methods in terms of pose estimation accuracy for dense visual and sparse tactile point clouds.
Förderung
- Bayerische Motoren Werke
- EU Horizon Project PHASTRAC
Zitieren
APA
Murali, P. K., Porr, B., & Kaboli, M. (2025). Shared visuo-tactile interactive perception for robust object pose estimation. The International Journal of Robotics Research, 44(7), 1186-1216. https://doi.org/10.1177/02783649241301443
Vancouver
Murali PK, Porr B, Kaboli M. Shared visuo-tactile interactive perception for robust object pose estimation. The International Journal of Robotics Research. 2025;44(7):1186-1216. doi:10.1177/02783649241301443
BibTeX
@article{Murali2025,
author = {Murali, Prajval Kumar and Porr, Bernd and Kaboli, Mohsen},
title = {Shared visuo-tactile interactive perception for robust object pose estimation},
journal = {The International Journal of Robotics Research},
year = {2025},
volume = {44},
number = {7},
pages = {1186--1216},
doi = {10.1177/02783649241301443}
}
EUVIMED