EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Object-centric diffusion policies for real-world robotic-arm imitation learning

Prashant Reddy Kasu, Dugan Um

Frontiers in Robotics and AI · 15.07.2026 · 13

DOI: 10.3389/frobt.2026.1829436 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Frontiers in Robotics and AI, online erschienen am 15.07.2026. Verfasst von Prashant Reddy Kasu und 1 weiteren Autor:innen. Beteiligte Einrichtung: College of Computer Science and Engineering, Computer Science, Texas A&M University - Corpus Christi, Corpus Christi, TX, United States. Die Arbeit nennt 41 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Imitation learning in complex, unstructured environments remains challenging due to the difficulty of grounding perception in physically meaningful representations and the need to model multimodal action distributions. Existing approaches often rely on unstructured pixel-level feature encodings or stochastic latent-variable decoders, which can lead to brittle attention in cluttered scenes. In this work, we present a novel integration of detector-based visual representations with conditional diffusion modeling (DINO + CDP) for real-world robotic imitation learning. Our framework utilizes a DINO object detection transformer to extract spatially-grounded object-query embeddings that serve as the conditioning signal for a diffusion-based policy. A primary contribution of this work is the systematic quantification of how scene complexity—measured via image entropy—affects robotic policy performance. By comparing rigid-object baselines with complex biological plant scenes, we demonstrate that organic morphology induces a measurable increase in pixel-level uncertainty that degrades standard pixel-centric models. Our results show that DINO + CDP mitigates this degradation by grounding action generation in stable object-level features. We evaluate our approach using a fully real-world manipulation dataset collected without simulation or synthetic pre-training. To isolate the impact of our architectural choices, we conduct a comparative study within a unified framework against convolutional (CNN-MLP), transformer-patch (ViT), and latent-variable (DETR + CVAE) variants. Experimental results in a robotic-arm biocell setup demonstrate that object-query-conditioned diffusion significantly improves task success rates, produces smoother trajectories, and exhibits superior robustness to high-entropy visual inputs, establishing a scalable pathway for imitation learning in challenging agricultural domains.

Schlagwörter

Stichwörter der Autor:innen

DINO (DETR-based object detection)diffusion policyimitation learningmultimodal action generationreal-world roboticsrobotic manipulationtransformer-based vision

Autor:innen und Institutionen

  • College of Computer Science and Engineering, Computer Science, Texas A&M University - Corpus Christi, Corpus Christi, TX, United States.
  • College of Computer Science and Engineering, Mechanical Engineering, Texas A&M University - Corpus Christi, Corpus Christi, TX, United States.

Zitieren

APA

Kasu, P. R., & Um, D. (2026). Object-centric diffusion policies for real-world robotic-arm imitation learning. Frontiers in Robotics and AI, 13. https://doi.org/10.3389/frobt.2026.1829436

Vancouver

Kasu PR, Um D. Object-centric diffusion policies for real-world robotic-arm imitation learning. Frontiers in Robotics and AI. 2026;13. doi:10.3389/frobt.2026.1829436

BibTeX
@article{Kasu2026,
  author = {Kasu, Prashant Reddy and Um, Dugan},
  title = {Object-centric diffusion policies for real-world robotic-arm imitation learning},
  journal = {Frontiers in Robotics and AI},
  year = {2026},
  volume = {13},
  doi = {10.3389/frobt.2026.1829436}
}
Kostenlos starten →