Scenario-Free Autonomous Driving With Multi-Task Offline-to-Online Reinforcement Learning
IEEE Transactions on Intelligent Transportation Systems · 2025-09 · 26 (9) · 13317-13330
DOI: 10.1109/tits.2025.3583635 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Intelligent Transportation Systems, 2025-09. Verfasst von Dongsu Lee und 1 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 69 Literaturangaben. Gefördert von: National Research Foundation of Korea, Institute of Information and Communications Technology Planning and Evaluation (IITP)-Information Technology Research Center (IITP) grant funded by Korea Gover….
Abstract (Originalsprache)
The primary goal of an autonomous driving system is to achieve full autonomy by integrating the capability of adaptive decision-making across a wide range of driving scenarios. Despite recent advances in reinforcement learning (RL) enabling the development of policies for adaptive behaviors, current solutions are typically tailored for specific driving scenarios (e.g., highway, tollgate) rather than providing a scenario-free solution. To address this limitation, this study focuses on developing an autonomous driving policy that can operate across diverse driving scenarios through a generalized decision-making model. Specifically, an autonomous vehicle learns a unified multi-task policy by utilizing a shared replay buffer across all scenarios, thereby enhancing sample and learning efficiencies. Furthermore, we adopt an offline-to-online RL approach to leverage both the sample efficiency of offline RL and the performance improvements of online RL. The proposed solution involves an algorithmic shift aimed at maximizing the objectives of each RL method, incorporating three key techniques: Q re-initialization, Q adaptation, and policy variance re-initialization. To validate our solution, we compare its performance with existing RL methods and analyze driving behavior using objective-aware and safety-aware metrics. Our findings demonstrate that the proposed solution achieves superior performance across most metrics, irrespective of dataset quality.
Förderung
- National Research Foundation of Korea
- Institute of Information and Communications Technology Planning and Evaluation (IITP)-Information Technology Research Center (IITP) grant funded by Korea Gover…
Zitieren
APA
Lee, D., & Kwon, M. (2025). Scenario-Free Autonomous Driving With Multi-Task Offline-to-Online Reinforcement Learning. IEEE Transactions on Intelligent Transportation Systems, 26(9), 13317-13330. https://doi.org/10.1109/tits.2025.3583635
Vancouver
Lee D, Kwon M. Scenario-Free Autonomous Driving With Multi-Task Offline-to-Online Reinforcement Learning. IEEE Transactions on Intelligent Transportation Systems. 2025;26(9):13317-13330. doi:10.1109/tits.2025.3583635
BibTeX
@article{Lee2025,
author = {Lee, Dongsu and Kwon, Minhae},
title = {Scenario-Free Autonomous Driving With Multi-Task Offline-to-Online Reinforcement Learning},
journal = {IEEE Transactions on Intelligent Transportation Systems},
year = {2025},
volume = {26},
number = {9},
pages = {13317--13330},
doi = {10.1109/tits.2025.3583635}
}
EUVIMED