EUVIMEDEUVIMED entdecken
Crossref

Dynamic robotic tracking of underwater targets using reinforcement learning

I Masmitja iD, M Martin iD, T O'Reilly iD, B Kieft, N Palomeras iD, J Navarro iD, K Katija iD

Science Robotics · 12.07.2023 · 8 (80)

DOI: 10.1126/scirobotics.ade7811 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Science Robotics, erschienen am 12.07.2023. Verfasst von I Masmitja und 6 weiteren Autor:innen. Beteiligte Einrichtung: Institut de Ciències del Mar (ICM), CSIC, Barcelona 95062, Spain. Hauptthemen laut MEDLINE: Robotics. Die Arbeit wurde bisher 102-mal zitiert (Crossref) und nennt 65 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

To realize the potential of autonomous underwater robots that scale up our observational capacity in the ocean, new techniques are needed. Fleets of autonomous robots could be used to study complex marine systems and animals with either new imaging configurations or by tracking tagged animals to study their behavior. These activities can then inform and create new policies for community conservation. The role of animal connectivity via active movement of animals represents a major knowledge gap related to the distribution of deep ocean populations. Tracking underwater targets represents a major challenge for observing biological processes in situ, and methods to robustly respond to a changing environment during monitoring missions are needed. Analytical techniques for optimal sensor placement and path planning to locate underwater targets are not straightforward in such cases. The aim of this study was to investigate the use of reinforcement learning as a tool for range-only underwater target-tracking optimization, whose promising capabilities have been demonstrated in terrestrial scenarios. To evaluate its usefulness, a reinforcement learning method was implemented as a path planning system for an autonomous surface vehicle while tracking an underwater mobile target. A complete description of an open-source model, performance metrics in simulated environments, and evaluated algorithms based on more than 15 hours of at-sea field experiments are presented. These efforts demonstrate that deep reinforcement learning is a powerful approach that enhances the abilities of autonomous robots in the ocean and encourages the deployment of algorithms like these for monitoring marine biological systems in the future.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

RoboticsAnimalsAlgorithmsLearningReinforcement, Psychology

Autor:innen und Institutionen

  • Institut de Ciències del Mar (ICM), CSIC, Barcelona 95062, Spain.
  • Research and Development, Bioinspiration Lab, Monterey Bay Aquarium Research Institute MBARI, Moss Landing, CA 95062, USA.
  • Knowledge Engineering and Machine Learning Group, Universitat Politècnica de Catalunya, Barcelona Tech., Barcelona 08034, Spain.
  • Barcelona Supercomputing Center (BSC), Barcelona 08034, Spain.
  • Computer vision and Robotics Institute, Universitat de Girona, Girona 17003, Spain.

ORCID-Profile: I Masmitja, M Martin, T O'Reilly, N Palomeras, J Navarro, K Katija

Zitieren

APA

Masmitja, I., Martin, M., O'Reilly, T., Kieft, B., Palomeras, N., Navarro, J., & Katija, K. (2023). Dynamic robotic tracking of underwater targets using reinforcement learning. Science Robotics, 8(80). https://doi.org/10.1126/scirobotics.ade7811

Vancouver

Masmitja I, Martin M, O'Reilly T, Kieft B, Palomeras N, Navarro J, et al. Dynamic robotic tracking of underwater targets using reinforcement learning. Science Robotics. 2023;8(80). doi:10.1126/scirobotics.ade7811

BibTeX
@article{Masmitja2023,
  author = {Masmitja, I and Martin, M and O'Reilly, T and Kieft, B and Palomeras, N and Navarro, J and Katija, K},
  title = {Dynamic robotic tracking of underwater targets using reinforcement learning},
  journal = {Science Robotics},
  year = {2023},
  volume = {8},
  number = {80},
  doi = {10.1126/scirobotics.ade7811}
}
Kostenlos starten →