EUVIMEDEUVIMED entdecken
Crossref

Rethinking Progression of Memory State in Robotic Manipulation: An Object-Centric Perspective

Nhat Chung, Taisei Hanyu, Toan Nguyen, Huy Le, Frederick Bumgarner, Duy Minh Ho Nguyen, Khoa Vo, Kashu Yamazaki, Chase Rainwater, Tung Kieu, Anh Nguyen, Ngan Le

Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (5) · 3407-3415

DOI: 10.1609/aaai.v40i5.37337 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Nhat Chung und 11 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

As embodied agents operate in increasingly complex environments, the ability to perceive, track, and reason about individual object instances over time becomes essential, especially in tasks requiring sequenced interactions with visually similar objects. In non-Markovian settings, critical decision cues lie in object histories rather than the current scene. Without persistent memory of prior interactions (what was used, where it was placed, or how it changed), visuomotor policies may fail, repeat past actions, or overlook completed ones. To surface this challenge, we introduce LIBERO-Mem, a non-Markovian task suite for stress-testing robotic manipulation under object-level partial observability. It combines short- and long-horizon object tracking with temporally sequenced subgoals, requiring reasoning beyond the current frame. However, vision-language-action (VLA) models often struggle in such settings, with token scaling quickly becoming intractable even for tasks spanning just a few hundred frames. We propose Embodied-SlotSSM, a slot-centric VLA framework built for temporal scalability. It maintains spatio-temporally consistent slot identities and leverages them through two mechanisms: (1) slot-state-space modeling for reconstructing short-term history, and (2) a relational encoder to align the input tokens with action decoding. Together, these components enable temporally grounded, context-aware action prediction. Experiments show Embodied-SlotSSM's baseline performance on LIBERO-Mem and general tasks, offering a scalable solution for non-Markovian reasoning in object-centric policies.

Zitieren

APA

Chung, N., Hanyu, T., Nguyen, T., Le, H., Bumgarner, F., Nguyen, D. M. H., Vo, K., Yamazaki, K., Rainwater, C., Kieu, T., Nguyen, A., & Le, N. (2026). Rethinking Progression of Memory State in Robotic Manipulation: An Object-Centric Perspective. Proceedings of the AAAI Conference on Artificial Intelligence, 40(5), 3407-3415. https://doi.org/10.1609/aaai.v40i5.37337

Vancouver

Chung N, Hanyu T, Nguyen T, Le H, Bumgarner F, Nguyen DMH, et al. Rethinking Progression of Memory State in Robotic Manipulation: An Object-Centric Perspective. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(5):3407-3415. doi:10.1609/aaai.v40i5.37337

BibTeX
@article{Chung2026,
  author = {Chung, Nhat and Hanyu, Taisei and Nguyen, Toan and Le, Huy and Bumgarner, Frederick and Nguyen, Duy Minh Ho and Vo, Khoa and Yamazaki, Kashu and Rainwater, Chase and Kieu, Tung and Nguyen, Anh and Le, Ngan},
  title = {Rethinking Progression of Memory State in Robotic Manipulation: An Object-Centric Perspective},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2026},
  volume = {40},
  number = {5},
  pages = {3407--3415},
  doi = {10.1609/aaai.v40i5.37337}
}
Kostenlos starten →