An Active Olfaction Approach Using Deep Reinforcement Learning for Indoor Attenuation Odor Source Localization
IEEE Sensors Journal · 01.05.2024 · 24 (9) · 14561-14572
DOI: 10.1109/jsen.2024.3373610 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Sensors Journal, erschienen am 01.05.2024. Verfasst von Hui Li und 2 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 28 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Natural Science Foundation of Xinjiang Uygur Autonomous Region.
Abstract (Originalsprache)
The localization of odor sources (e.g., poisonous odor sources) is an important task for the security of the environment and human society. Traditional robot localization methods are sensitive to environmental changes, leading to localization performance degradation in dynamic environments and complex scenes. The time-varying odor sources are not fully taken into account by the traditional robot localization method in turbulent environments, resulting in low search efficiency and even failure. This article proposes the odor source localization (OSL) algorithm using a proximal policy optimization based on a gated recurrent unit algorithm (GRU-PPO). First, the OSL problem is modeled as a Markov decision process (MDP), and the state space, action space, and dense rewards are designed to address the sparse reward problem. Second, the gated recurrent unit (GRU) network is applied to the actor-critic framework of the PPO algorithm to extract temporal features from historical data and generate optimal decisions in an end-to-end manner. Finally, in an indoor turbulent environment, the feasibility of the proposed GRU-PPO algorithm for source localization is verified by simulating the leakage process of a decaying plume source using computational fluid dynamics (CFDs). The algorithm’s effectiveness is demonstrated in diverse and complex environments, with a success rate maintained at a high level (99%).
Förderung
- National Natural Science Foundation of China
- Natural Science Foundation of Xinjiang Uygur Autonomous Region
Zitieren
APA
Li, H., Yuan, J., & Yuan, H. (2024). An Active Olfaction Approach Using Deep Reinforcement Learning for Indoor Attenuation Odor Source Localization. IEEE Sensors Journal, 24(9), 14561-14572. https://doi.org/10.1109/jsen.2024.3373610
Vancouver
Li H, Yuan J, Yuan H. An Active Olfaction Approach Using Deep Reinforcement Learning for Indoor Attenuation Odor Source Localization. IEEE Sensors Journal. 2024;24(9):14561-14572. doi:10.1109/jsen.2024.3373610
BibTeX
@article{Li2024,
author = {Li, Hui and Yuan, Jie and Yuan, Hao},
title = {An Active Olfaction Approach Using Deep Reinforcement Learning for Indoor Attenuation Odor Source Localization},
journal = {IEEE Sensors Journal},
year = {2024},
volume = {24},
number = {9},
pages = {14561--14572},
doi = {10.1109/jsen.2024.3373610}
}
EUVIMED