A Transformation-Aggregation Framework for State Representation of Autonomous Driving Systems
IEEE Transactions on Intelligent Transportation Systems · 2024-07 · 25 (7) · 7311-7322
DOI: 10.1109/tits.2023.3348489 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Intelligent Transportation Systems, 2024-07. Verfasst von Guojian Zhan und 5 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 24 Literaturangaben. Gefördert von: National Key Research and Development Program of China, Tsinghua University Initiative Scientific Research Program, Tsinghua University-Toyota Joint Research Center for AI Technology of Automated Vehicle.
Abstract (Originalsprache)
The effective design of state representation plays a pivotal role in bridging the gap between perception and downstream decision-making and control in autonomous driving systems based on reinforcement learning. Among perception observations, accurately representing the set of surrounding participants poses significant challenges due to its variable size and unordered nature. These challenges result in dimension sensitivity and permutation sensitivity issues, respectively. To systematically tackle these complexities, we introduce a general framework for learning a state representation module, which can be regarded as a combination of any transformation and aggregation modules. Specifically, we employ a transformer encoder as the transformation module to attract features individually and design a novel aggregation module called Feature-wise Sorted Query (FSQ) to effectively aggregate the feature set into a state representation vector while adaptively attending to essential participant features. In FSQ, the feature-wise sort and latent query attention mechanisms can address permutation sensitivity and dimension sensitivity, respectively. Additionally, we propose an offline training paradigm to decouple state representation learning from downstream reinforcement learning tasks, enhancing stability and avoiding overfitting for particular scenarios. Simulation and experimental results demonstrate the superior performance and a more stable training process of our method across six varying-size set regression tasks and downstream autonomous driving tasks, particularly when leveraging the offline training paradigm.
Förderung
- National Key Research and Development Program of China
- Tsinghua University Initiative Scientific Research Program
- Tsinghua University-Toyota Joint Research Center for AI Technology of Automated Vehicle
Zitieren
APA
Zhan, G., Jiang, Y., Li, S. E., Lyu, Y., Zhang, X., & Yin, Y. (2024). A Transformation-Aggregation Framework for State Representation of Autonomous Driving Systems. IEEE Transactions on Intelligent Transportation Systems, 25(7), 7311-7322. https://doi.org/10.1109/tits.2023.3348489
Vancouver
Zhan G, Jiang Y, Li SE, Lyu Y, Zhang X, Yin Y. A Transformation-Aggregation Framework for State Representation of Autonomous Driving Systems. IEEE Transactions on Intelligent Transportation Systems. 2024;25(7):7311-7322. doi:10.1109/tits.2023.3348489
BibTeX
@article{Zhan2024,
author = {Zhan, Guojian and Jiang, Yuxuan and Li, Shengbo Eben and Lyu, Yao and Zhang, Xiangteng and Yin, Yuming},
title = {A Transformation-Aggregation Framework for State Representation of Autonomous Driving Systems},
journal = {IEEE Transactions on Intelligent Transportation Systems},
year = {2024},
volume = {25},
number = {7},
pages = {7311--7322},
doi = {10.1109/tits.2023.3348489}
}
EUVIMED