Precise chirp control with model-based reinforcement learning for broadband frequency-swept laser of LiDAR
Optics Express · 05.06.2023 · 31 (12) · 20286
DOI: 10.1364/oe.488283 ↗Kurz gefasst
Fachartikel in der Zeitschrift Optics Express, online erschienen am 01.06.2023. Verfasst von Haohao Zhao und 2 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 30 Literaturangaben. Gefördert von: Natural Science Foundation of Sichuan, China, Zhejiang Provincial Natural Science Foundation of China, Medico-Engineering Cooperation Funds from University of Electronic Science and Technology of China.
Abstract (Originalsprache)
Artificial intelligence (AI) has been widely used in various fields of physics and engineering in recent decades. In this work, we introduce model-based reinforcement learning (MBRL), which is an important branch of machine learning in the AI domain, to the broadband frequency-swept laser control for frequency modulated continuous wave (FMCW) light detection and ranging (LiDAR). With the concern of the direct interaction between the optical system and the MBRL agent, we establish the frequency measurement system model on the basis of the experimental data and the nonlinearity property of the system. In light of the difficulty of this challenging high-dimensional control task, we propose a twin critic network on the basis of the Actor-Critic structure to better learn the complex dynamic characteristics of the frequency-swept process. Furthermore, the proposed MBRL structure would stabilize the optimization process greatly. In the training process of the neural network, we apply a delaying strategy to the policy update and introduce a smoothing regularization strategy to the target policy to further enhance the network stability. With the well-trained control policy, the agent generates the excellent and regularly updated modulation signals to control the laser chirp precisely and an excellent detection resolution is obtained eventually. Our proposed work demonstrates that the integration of data-driven reinforcement learning (RL) and optical system control gives an opportunity to reduce the system complexity and accelerate the investigation and optimization of control systems.
Förderung
- Natural Science Foundation of Sichuan, China
- Zhejiang Provincial Natural Science Foundation of China
- Medico-Engineering Cooperation Funds from University of Electronic Science and Technology of China
- Municipal Government of Quzhou
- Quzhou City Science and Technology Project
Zitieren
APA
Zhao, H., Yuan, G., & Wang, Z. (2023). Precise chirp control with model-based reinforcement learning for broadband frequency-swept laser of LiDAR. Optics Express, 31(12), 20286. https://doi.org/10.1364/oe.488283
Vancouver
Zhao H, Yuan G, Wang Z. Precise chirp control with model-based reinforcement learning for broadband frequency-swept laser of LiDAR. Optics Express. 2023;31(12):20286. doi:10.1364/oe.488283
BibTeX
@article{Zhao2023,
author = {Zhao, Haohao and Yuan, Guohui and Wang, Zhuoran},
title = {Precise chirp control with model-based reinforcement learning for broadband frequency-swept laser of LiDAR},
journal = {Optics Express},
year = {2023},
volume = {31},
number = {12},
pages = {20286},
doi = {10.1364/oe.488283}
}
EUVIMED