Manipulator URDF Bundles Across Simulators: A Preliminary Study of Their Sim-to-Sim and Real-to-Sim Visual Matching
Proceedings of the AAAI Symposium Series · 06.11.2026 · 10 (1) · 881-884
DOI: 10.1609/aaaiss.v10i1.43502 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Symposium Series, online erschienen am 06.11.2026. Verfasst von Yue Cao.
Abstract (Originalsprache)
The simulator is an important tool in robot learning, since training directly on real robots is costly and risky. An increasing number of robot learning frameworks use camera views as a system input. This raises a question of whether different simulators render the same robot in the same way. This work focuses on a sub-area: the rendering of Unified Robot Description Format (URDF) bundles of manipulators. URDF is a widely used format for defining robot structure and kinematics. This preliminary study investigates two questions: Q1 (Sim-to-Sim), do different simulators render the same manipulator URDF bundle in the same way, and Q2 (Real-to-Sim), given a real robot, can its corresponding URDF bundle be identified from its appearance. To study these questions, this work first constructs a canonical-view rendering dataset of 131 manipulator URDF bundles across MuJoCo and PyBullet. For Q1, this work compares six visual similarity methods across all 131 manipulator URDF bundles in the dataset. These methods range from pixel-level and classical feature-based approaches to pretrained image embedding models, including CLIP, I-JEPA, DINOv2, and SigLIP2. For Q2, a preliminary real-to-sim retrieval demonstration is presented to explore whether a real robot photo can be matched to its corresponding URDF bundle.
Zitieren
APA
Cao, Y. (2026). Manipulator URDF Bundles Across Simulators: A Preliminary Study of Their Sim-to-Sim and Real-to-Sim Visual Matching. Proceedings of the AAAI Symposium Series, 10(1), 881-884. https://doi.org/10.1609/aaaiss.v10i1.43502
Vancouver
Cao Y. Manipulator URDF Bundles Across Simulators: A Preliminary Study of Their Sim-to-Sim and Real-to-Sim Visual Matching. Proceedings of the AAAI Symposium Series. 2026;10(1):881-884. doi:10.1609/aaaiss.v10i1.43502
BibTeX
@article{Cao2026,
author = {Cao, Yue},
title = {Manipulator URDF Bundles Across Simulators: A Preliminary Study of Their Sim-to-Sim and Real-to-Sim Visual Matching},
journal = {Proceedings of the AAAI Symposium Series},
year = {2026},
volume = {10},
number = {1},
pages = {881--884},
doi = {10.1609/aaaiss.v10i1.43502}
}
EUVIMED