Optimizing Robotic Manipulation With Decision-RWKV: A Recurrent Sequence Modeling Approach for Lifelong Learning
Journal of Computing and Information Science in Engineering · 01.03.2025 · 25 (3)
DOI: 10.1115/1.4067524 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Computing and Information Science in Engineering, online erschienen am 27.01.2025. Verfasst von Yujian Dong und 2 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 39 Literaturangaben. Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
Models based on the transformer architecture have seen widespread application across fields such as natural language processing (NLP), computer vision, and robotics, with large language models (LLMs) like ChatGPT revolutionizing machine understanding of human language and demonstrating impressive memory capacity and reproduction capabilities. Traditional machine learning algorithms struggle with catastrophic forgetting, detrimental to the diverse and generalized abilities required for robotic deployment. This article investigates the receptance weighted key value (RWKV) framework, known for its advanced capabilities in efficient and effective sequence modeling, integration with the decision transformer (DT), and experience replay architectures. It focuses on potential performance enhancements in sequence decision-making and lifelong robotic learning tasks. We introduce the decision-RWKV (DRWKV) model and conduct extensive experiments using the D4RL database within the OpenAI Gym environment and on the D’Claw platform to assess the DRWKV model’s performance in single-task tests and lifelong learning scenarios, showing its ability to handle multiple subtasks efficiently. The code for all algorithms, training, and image rendering in this study is available online (open source).
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Dong, Y., Wu, T., & Song, C. (2025). Optimizing Robotic Manipulation With Decision-RWKV: A Recurrent Sequence Modeling Approach for Lifelong Learning. Journal of Computing and Information Science in Engineering, 25(3). https://doi.org/10.1115/1.4067524
Vancouver
Dong Y, Wu T, Song C. Optimizing Robotic Manipulation With Decision-RWKV: A Recurrent Sequence Modeling Approach for Lifelong Learning. Journal of Computing and Information Science in Engineering. 2025;25(3). doi:10.1115/1.4067524
BibTeX
@article{Dong2025,
author = {Dong, Yujian and Wu, Tianyu and Song, Chaoyang},
title = {Optimizing Robotic Manipulation With Decision-RWKV: A Recurrent Sequence Modeling Approach for Lifelong Learning},
journal = {Journal of Computing and Information Science in Engineering},
year = {2025},
volume = {25},
number = {3},
doi = {10.1115/1.4067524}
}
EUVIMED