EUVIMEDEUVIMED entdecken
Crossref

Precise chirp control with model-based reinforcement learning for broadband frequency-swept laser of LiDAR

Haohao Zhao, Guohui Yuan, Zhuoran Wang

Optics Express · 05.06.2023 · 31 (12) · 20286

DOI: 10.1364/oe.488283 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Optics Express, online erschienen am 01.06.2023. Verfasst von Haohao Zhao und 2 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 30 Literaturangaben. Gefördert von: Natural Science Foundation of Sichuan, China, Zhejiang Provincial Natural Science Foundation of China, Medico-Engineering Cooperation Funds from University of Electronic Science and Technology of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Artificial intelligence (AI) has been widely used in various fields of physics and engineering in recent decades. In this work, we introduce model-based reinforcement learning (MBRL), which is an important branch of machine learning in the AI domain, to the broadband frequency-swept laser control for frequency modulated continuous wave (FMCW) light detection and ranging (LiDAR). With the concern of the direct interaction between the optical system and the MBRL agent, we establish the frequency measurement system model on the basis of the experimental data and the nonlinearity property of the system. In light of the difficulty of this challenging high-dimensional control task, we propose a twin critic network on the basis of the Actor-Critic structure to better learn the complex dynamic characteristics of the frequency-swept process. Furthermore, the proposed MBRL structure would stabilize the optimization process greatly. In the training process of the neural network, we apply a delaying strategy to the policy update and introduce a smoothing regularization strategy to the target policy to further enhance the network stability. With the well-trained control policy, the agent generates the excellent and regularly updated modulation signals to control the laser chirp precisely and an excellent detection resolution is obtained eventually. Our proposed work demonstrates that the integration of data-driven reinforcement learning (RL) and optical system control gives an opportunity to reduce the system complexity and accelerate the investigation and optimization of control systems.

Förderung

  • Natural Science Foundation of Sichuan, China
  • Zhejiang Provincial Natural Science Foundation of China
  • Medico-Engineering Cooperation Funds from University of Electronic Science and Technology of China
  • Municipal Government of Quzhou
  • Quzhou City Science and Technology Project

Zitieren

APA

Zhao, H., Yuan, G., & Wang, Z. (2023). Precise chirp control with model-based reinforcement learning for broadband frequency-swept laser of LiDAR. Optics Express, 31(12), 20286. https://doi.org/10.1364/oe.488283

Vancouver

Zhao H, Yuan G, Wang Z. Precise chirp control with model-based reinforcement learning for broadband frequency-swept laser of LiDAR. Optics Express. 2023;31(12):20286. doi:10.1364/oe.488283

BibTeX
@article{Zhao2023,
  author = {Zhao, Haohao and Yuan, Guohui and Wang, Zhuoran},
  title = {Precise chirp control with model-based reinforcement learning for broadband frequency-swept laser of LiDAR},
  journal = {Optics Express},
  year = {2023},
  volume = {31},
  number = {12},
  pages = {20286},
  doi = {10.1364/oe.488283}
}
Kostenlos starten →