RAGLRO: Retrieval‐Augmented Generation With Large Language Models for Robotic Operations
CAAI Transactions on Intelligence Technology · 2026-04 · 11 (2) · 385-395
DOI: 10.1049/cit2.70105 ↗Kurz gefasst
Fachartikel in der Zeitschrift CAAI Transactions on Intelligence Technology, online erschienen am 30.01.2026. Verfasst von Wenrui Wang und 6 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: National Key Research and Development Program of China, Natural Science Foundation of Shenzhen Municipality, National Natural Science Foundation of China.
Abstract (Originalsprache)
To enable autonomous operations in complex industrial environments, this paper proposes retrieval‐augmented generation with large language models for robotic operations (RAGLRO), a robotic framework specifically designed for power switchgear operation tasks. The system integrates multimodal perception with high‐level semantic reasoning and task‐level action generation. A depth camera captures the environmental context, which is processed by visual modules to perform object detection and pose detection. The perception outputs are formulated into structured prompts and provided to a large language model (LLM) equipped with a retrieval‐augmented generation (RAG) mechanism. The RAG component enables the LLM to dynamically access a task‐specific knowledge base, including operation manuals, safety protocols and historical mission data, thereby enhancing contextual understanding and reasoning precision. Based on the retrieved knowledge and current environmental perception, the LLM selects and sequences callable action functions from a predefined robotic action library to generate executable robot control commands. A dedicated dataset for power switchgear operations is also constructed to support robust visual perception, containing annotated images for object detection and pose detection tasks. Experimental results demonstrate that RAGLRO achieves high task success rates and strong adaptability in real‐world power maintenance scenarios, validating the effectiveness of integrating multimodal perception, LLM‐based reasoning and RAG‐grounded task planning within a unified robotic control framework.
Förderung
- National Key Research and Development Program of China
- Natural Science Foundation of Shenzhen Municipality
- National Natural Science Foundation of China
Zitieren
APA
Wang, W., Wang, P., Chen, Y., Zhang, X., Song, P., Cherkasov, O., & Fan, X. (2026). RAGLRO: Retrieval‐Augmented Generation With Large Language Models for Robotic Operations. CAAI Transactions on Intelligence Technology, 11(2), 385-395. https://doi.org/10.1049/cit2.70105
Vancouver
Wang W, Wang P, Chen Y, Zhang X, Song P, Cherkasov O, et al. RAGLRO: Retrieval‐Augmented Generation With Large Language Models for Robotic Operations. CAAI Transactions on Intelligence Technology. 2026;11(2):385-395. doi:10.1049/cit2.70105
BibTeX
@article{Wang2026,
author = {Wang, Wenrui and Wang, Penghong and Chen, Yang and Zhang, Xianqi and Song, Pinhao and Cherkasov, Oleg and Fan, Xiaopeng},
title = {RAGLRO: Retrieval‐Augmented Generation With Large Language Models for Robotic Operations},
journal = {CAAI Transactions on Intelligence Technology},
year = {2026},
volume = {11},
number = {2},
pages = {385--395},
doi = {10.1049/cit2.70105}
}
EUVIMED