Visual Sculpting: Visually-Aligned Planning Representations for Long-Horizon Robot Clay Sculpting
IEEE Robotics and Automation Letters · 2026-05 · 11 (5) · 5494-5501
DOI: 10.1109/lra.2026.3673896 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Robotics and Automation Letters, 2026-05. Verfasst von Peter Schaldenbrand und 1 weiteren Autor:innen. Die Arbeit nennt 20 Literaturangaben. Gefördert von: NSF, JPMorgan Chase Faculty Research Award.
Abstract (Originalsprache)
Clay sculpting is a nuanced, artistic task involving dexterous manipulation with long-horizon planning to achieve high-level goals. As a robotics problem, we formulate clay sculpting as a shape-to-shape matching challenge. Prior deformable object manipulation work either requires retraining a policy per goal or relies on dynamics models which represent state as sparse point clouds which do not capture important clay features, such as textures, well. We present a method for modeling the dynamics of deformable materials and planning for robotic sculpting in a representation that is visually-aligned, capturing lighting and texture features. With three different deformable materials and various end-effectors, we demonstrate that our dynamics model is comparable in performance to the state-of-the-art with the added benefit of being compatible with visual planning. Our actions are represented as parametrized pushes into clay with a single end-effector, which proved to be suitable for long-horizon ($>$100 actions) clay relief sculptures. Lastly, we show the benefits of planning in a visually-aligned representation, but also provide analysis providing evidence as to why this representation is challenging to plan in compared to 3D representations.
Förderung
- NSF
- JPMorgan Chase Faculty Research Award
Zitieren
APA
Schaldenbrand, P., & Oh, J. (2026). Visual Sculpting: Visually-Aligned Planning Representations for Long-Horizon Robot Clay Sculpting. IEEE Robotics and Automation Letters, 11(5), 5494-5501. https://doi.org/10.1109/lra.2026.3673896
Vancouver
Schaldenbrand P, Oh J. Visual Sculpting: Visually-Aligned Planning Representations for Long-Horizon Robot Clay Sculpting. IEEE Robotics and Automation Letters. 2026;11(5):5494-5501. doi:10.1109/lra.2026.3673896
BibTeX
@article{Schaldenbrand2026,
author = {Schaldenbrand, Peter and Oh, Jean},
title = {Visual Sculpting: Visually-Aligned Planning Representations for Long-Horizon Robot Clay Sculpting},
journal = {IEEE Robotics and Automation Letters},
year = {2026},
volume = {11},
number = {5},
pages = {5494--5501},
doi = {10.1109/lra.2026.3673896}
}
EUVIMED