AID-RL: Active information-directed reinforcement learning for autonomous source seeking and estimation
Neurocomputing · 2023-08 · 544 · 126281
DOI: 10.1016/j.neucom.2023.126281 ↗Kurz gefasst
Fachartikel in der Zeitschrift Neurocomputing, 2023-08. Verfasst von Zhongguo Li und 3 weiteren Autor:innen. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Engineering and Physical Sciences Research Council.
Abstract (Originalsprache)
This paper proposes an active information-directed reinforcement learning (AID-RL) framework for autonomous source seeking and estimation problem. Source seeking requires the search agent to move towards the true source, and source estimation demands the agent to maintain and update its knowledge regarding the source properties such as release rate and source position. These two objectives give rise to the newly developed framework, namely, dual control for exploration and exploitation. In this paper, the greedy RL forms an exploitation search strategy that navigates the agent to the source position, while the information-directed search commands the agent to explore most informative positions to reduce belief uncertainty. Extensive results are presented using a high-fidelity dataset for autonomous search, which validates the effectiveness of the proposed AID-RL and highlights the importance of active exploration in improving sampling efficiency and search performance. (cid:1) 2023 The Author(s). Published by Elsevier B.V. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).
Förderung
- Engineering and Physical Sciences Research Council
Zitieren
APA
Li, Z., Chen, W., Yang, J., & Yan, Y. (2023). AID-RL: Active information-directed reinforcement learning for autonomous source seeking and estimation. Neurocomputing, 544, 126281. https://doi.org/10.1016/j.neucom.2023.126281
Vancouver
Li Z, Chen W, Yang J, Yan Y. AID-RL: Active information-directed reinforcement learning for autonomous source seeking and estimation. Neurocomputing. 2023;544:126281. doi:10.1016/j.neucom.2023.126281
BibTeX
@article{Li2023,
author = {Li, Zhongguo and Chen, Wen-Hua and Yang, Jun and Yan, Yunda},
title = {AID-RL: Active information-directed reinforcement learning for autonomous source seeking and estimation},
journal = {Neurocomputing},
year = {2023},
volume = {544},
pages = {126281},
doi = {10.1016/j.neucom.2023.126281}
}
EUVIMED