EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Target-Oriented Multi-Agent Coordination with Hierarchical Reinforcement Learning

Yuekang Yu, Zhongyi Zhai, Weikun Li, Jianyu Ma

Applied Sciences · 12.08.2024 · 14 (16) · 7084

DOI: 10.3390/app14167084 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 12.08.2024. Verfasst von Yuekang Yu und 3 weiteren Autor:innen. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 49 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Guangxi Natural Science Foundation of China, Guangxi Science and Technology Project, National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In target-oriented multi-agent tasks, agents collaboratively achieve goals defined by specific objects, or targets, in their environment. The key to success is the effective coordination between agents and these targets, especially in dynamic environments where targets may shift. Agents must adeptly adjust to these changes and re-evaluate their target interactions. Inefficient coordination can lead to resource waste, extended task times, and lower overall performance. Addressing this challenge, we introduce the regulatory hierarchical multi-agent coordination (RHMC), a hierarchical reinforcement learning approach. RHMC divides the coordination task into two levels: a high-level policy, assigning targets based on environmental state, and a low-level policy, executing basic actions guided by individual target assignments and observations. Stabilizing RHMC’s high-level policy is crucial for effective learning. This stability is achieved by reward regularization, reducing reliance on the dynamic low-level policy. Such regularization ensures the high-level policy remains focused on broad coordination, not overly dependent on specific agent actions. By minimizing low-level policy dependence, RHMC adapts more seamlessly to environmental changes, boosting learning efficiency. Testing demonstrates RHMC’s superiority over existing methods in global reward and learning efficiency, highlighting its effectiveness in multi-agent coordination.

Förderung

  • Guangxi Natural Science Foundation of China
  • Guangxi Science and Technology Project
  • National Natural Science Foundation of China

Zitieren

APA

Yu, Y., Zhai, Z., Li, W., & Ma, J. (2024). Target-Oriented Multi-Agent Coordination with Hierarchical Reinforcement Learning. Applied Sciences, 14(16), 7084. https://doi.org/10.3390/app14167084

Vancouver

Yu Y, Zhai Z, Li W, Ma J. Target-Oriented Multi-Agent Coordination with Hierarchical Reinforcement Learning. Applied Sciences. 2024;14(16):7084. doi:10.3390/app14167084

BibTeX
@article{Yu2024,
  author = {Yu, Yuekang and Zhai, Zhongyi and Li, Weikun and Ma, Jianyu},
  title = {Target-Oriented Multi-Agent Coordination with Hierarchical Reinforcement Learning},
  journal = {Applied Sciences},
  year = {2024},
  volume = {14},
  number = {16},
  pages = {7084},
  doi = {10.3390/app14167084}
}
Kostenlos starten →