Hierarchical Multi-agent Model for Reinforced Medical Resource Allocation with Imperfect Information
ACM Transactions on Intelligent Systems and Technology · 28.02.2023 · 14 (1) · 1-27
DOI: 10.1145/3552436 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Intelligent Systems and Technology, online erschienen am 09.11.2022. Verfasst von Qianyue Hao und 4 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 61 Literaturangaben. Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China, Beijing Natural Science Foundation.
Abstract (Originalsprache)
With the advent of the COVID-19 pandemic, the shortage in medical resources became increasingly more evident. Therefore, efficient strategies for medical resource allocation are urgently needed. However, conventional rule-based methods employed by public health experts have limited capability in dealing with the complex and dynamic pandemic-spreading situation. In addition, model-based optimization methods such as dynamic programming (DP) fail to work since we cannot obtain a precise model in real-world situations most of the time. Model-free reinforcement learning (RL) is a powerful tool for decision-making; however, three key challenges exist in solving this problem via RL: (1) complex situations and countless choices for decision-making in the real world; (2) imperfect information due to the latency of pandemic spreading; and (3) limitations on conducting experiments in the real world since we cannot set up pandemic outbreaks arbitrarily. In this article, we propose a hierarchical RL framework with several specially designed components. We design a decomposed action space with a corresponding training algorithm to deal with the countless choices, ensuring efficient and real-time strategies. We design a recurrent neural network–based framework to utilize the imperfect information obtained from the environment. We also design a multi-agent voting method, which modifies the decision-making process considering the randomness during model training and, thus, improves the performance. We build a pandemic-spreading simulator based on real-world data, serving as the experimental platform. We then conduct extensive experiments. The results show that our method outperforms all baselines, which reduces infections and deaths by 14.25% on average without the multi-agent voting method and up to 15.44% with it.
Förderung
- National Key Research and Development Program of China
- National Natural Science Foundation of China
- Beijing Natural Science Foundation
- Beijing National Research Center for Information Science and Technology
- Tsinghua University — Tencent Joint Laboratory for Internet Innovation Technology
Zitieren
APA
Hao, Q., Xu, F., Chen, L., Hui, P., & Li, Y. (2023). Hierarchical Multi-agent Model for Reinforced Medical Resource Allocation with Imperfect Information. ACM Transactions on Intelligent Systems and Technology, 14(1), 1-27. https://doi.org/10.1145/3552436
Vancouver
Hao Q, Xu F, Chen L, Hui P, Li Y. Hierarchical Multi-agent Model for Reinforced Medical Resource Allocation with Imperfect Information. ACM Transactions on Intelligent Systems and Technology. 2023;14(1):1-27. doi:10.1145/3552436
BibTeX
@article{Hao2023,
author = {Hao, Qianyue and Xu, Fengli and Chen, Lin and Hui, Pan and Li, Yong},
title = {Hierarchical Multi-agent Model for Reinforced Medical Resource Allocation with Imperfect Information},
journal = {ACM Transactions on Intelligent Systems and Technology},
year = {2023},
volume = {14},
number = {1},
pages = {1--27},
doi = {10.1145/3552436}
}
EUVIMED