EUVIMEDEUVIMED entdecken
Crossref

Hierarchical Multi-agent Model for Reinforced Medical Resource Allocation with Imperfect Information

Qianyue Hao, Fengli Xu, Lin Chen, Pan Hui, Yong Li

ACM Transactions on Intelligent Systems and Technology · 28.02.2023 · 14 (1) · 1-27

DOI: 10.1145/3552436 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Intelligent Systems and Technology, online erschienen am 09.11.2022. Verfasst von Qianyue Hao und 4 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 61 Literaturangaben. Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China, Beijing Natural Science Foundation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

With the advent of the COVID-19 pandemic, the shortage in medical resources became increasingly more evident. Therefore, efficient strategies for medical resource allocation are urgently needed. However, conventional rule-based methods employed by public health experts have limited capability in dealing with the complex and dynamic pandemic-spreading situation. In addition, model-based optimization methods such as dynamic programming (DP) fail to work since we cannot obtain a precise model in real-world situations most of the time. Model-free reinforcement learning (RL) is a powerful tool for decision-making; however, three key challenges exist in solving this problem via RL: (1) complex situations and countless choices for decision-making in the real world; (2) imperfect information due to the latency of pandemic spreading; and (3) limitations on conducting experiments in the real world since we cannot set up pandemic outbreaks arbitrarily. In this article, we propose a hierarchical RL framework with several specially designed components. We design a decomposed action space with a corresponding training algorithm to deal with the countless choices, ensuring efficient and real-time strategies. We design a recurrent neural network–based framework to utilize the imperfect information obtained from the environment. We also design a multi-agent voting method, which modifies the decision-making process considering the randomness during model training and, thus, improves the performance. We build a pandemic-spreading simulator based on real-world data, serving as the experimental platform. We then conduct extensive experiments. The results show that our method outperforms all baselines, which reduces infections and deaths by 14.25% on average without the multi-agent voting method and up to 15.44% with it.

Förderung

  • National Key Research and Development Program of China
  • National Natural Science Foundation of China
  • Beijing Natural Science Foundation
  • Beijing National Research Center for Information Science and Technology
  • Tsinghua University — Tencent Joint Laboratory for Internet Innovation Technology

Zitieren

APA

Hao, Q., Xu, F., Chen, L., Hui, P., & Li, Y. (2023). Hierarchical Multi-agent Model for Reinforced Medical Resource Allocation with Imperfect Information. ACM Transactions on Intelligent Systems and Technology, 14(1), 1-27. https://doi.org/10.1145/3552436

Vancouver

Hao Q, Xu F, Chen L, Hui P, Li Y. Hierarchical Multi-agent Model for Reinforced Medical Resource Allocation with Imperfect Information. ACM Transactions on Intelligent Systems and Technology. 2023;14(1):1-27. doi:10.1145/3552436

BibTeX
@article{Hao2023,
  author = {Hao, Qianyue and Xu, Fengli and Chen, Lin and Hui, Pan and Li, Yong},
  title = {Hierarchical Multi-agent Model for Reinforced Medical Resource Allocation with Imperfect Information},
  journal = {ACM Transactions on Intelligent Systems and Technology},
  year = {2023},
  volume = {14},
  number = {1},
  pages = {1--27},
  doi = {10.1145/3552436}
}
Kostenlos starten →