Object-centric diffusion policies for real-world robotic-arm imitation learning
Frontiers in Robotics and AI · 15.07.2026 · 13
DOI: 10.3389/frobt.2026.1829436 ↗Kurz gefasst
Fachartikel in der Zeitschrift Frontiers in Robotics and AI, online erschienen am 15.07.2026. Verfasst von Prashant Reddy Kasu und 1 weiteren Autor:innen. Beteiligte Einrichtung: College of Computer Science and Engineering, Computer Science, Texas A&M University - Corpus Christi, Corpus Christi, TX, United States. Die Arbeit nennt 41 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Imitation learning in complex, unstructured environments remains challenging due to the difficulty of grounding perception in physically meaningful representations and the need to model multimodal action distributions. Existing approaches often rely on unstructured pixel-level feature encodings or stochastic latent-variable decoders, which can lead to brittle attention in cluttered scenes. In this work, we present a novel integration of detector-based visual representations with conditional diffusion modeling (DINO + CDP) for real-world robotic imitation learning. Our framework utilizes a DINO object detection transformer to extract spatially-grounded object-query embeddings that serve as the conditioning signal for a diffusion-based policy. A primary contribution of this work is the systematic quantification of how scene complexity—measured via image entropy—affects robotic policy performance. By comparing rigid-object baselines with complex biological plant scenes, we demonstrate that organic morphology induces a measurable increase in pixel-level uncertainty that degrades standard pixel-centric models. Our results show that DINO + CDP mitigates this degradation by grounding action generation in stable object-level features. We evaluate our approach using a fully real-world manipulation dataset collected without simulation or synthetic pre-training. To isolate the impact of our architectural choices, we conduct a comparative study within a unified framework against convolutional (CNN-MLP), transformer-patch (ViT), and latent-variable (DETR + CVAE) variants. Experimental results in a robotic-arm biocell setup demonstrate that object-query-conditioned diffusion significantly improves task success rates, produces smoother trajectories, and exhibits superior robustness to high-entropy visual inputs, establishing a scalable pathway for imitation learning in challenging agricultural domains.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- College of Computer Science and Engineering, Computer Science, Texas A&M University - Corpus Christi, Corpus Christi, TX, United States.
- College of Computer Science and Engineering, Mechanical Engineering, Texas A&M University - Corpus Christi, Corpus Christi, TX, United States.
Zitieren
APA
Kasu, P. R., & Um, D. (2026). Object-centric diffusion policies for real-world robotic-arm imitation learning. Frontiers in Robotics and AI, 13. https://doi.org/10.3389/frobt.2026.1829436
Vancouver
Kasu PR, Um D. Object-centric diffusion policies for real-world robotic-arm imitation learning. Frontiers in Robotics and AI. 2026;13. doi:10.3389/frobt.2026.1829436
BibTeX
@article{Kasu2026,
author = {Kasu, Prashant Reddy and Um, Dugan},
title = {Object-centric diffusion policies for real-world robotic-arm imitation learning},
journal = {Frontiers in Robotics and AI},
year = {2026},
volume = {13},
doi = {10.3389/frobt.2026.1829436}
}
EUVIMED