The pandemic caused by the SARS-CoV-2 virus has exposed many flaws in the decision-making strategies used to distribute resources to combat global health crises. In this paper, we leverage reinforcement learning and optimization to improve upon the allocation strategies for various resources. In particular, we consider a problem where a central controller must decide where to send testing kits to learn about the uncertain states of the world (active learning); then, use the new information to construct beliefs about the states and decide where to allocate resources. We propose a general model coupled with a tunable lookahead policy for making vaccine allocation decisions without perfect knowledge about the state of the world. The lookahead policy is compared to a population-based myopic policy which is more likely to be similar to the present strategies in practice. Each vaccine allocation policy works in conjunction with a testing kit allocation policy to perform active learning. Our simulation results demonstrate that an optimization-based lookahead decision making strategy will outperform the presented myopic policy.
翻译:SARS-COV-2病毒引起的大流行病暴露了用于分配资源以对付全球卫生危机的决策战略的许多缺陷。本文中,我们利用强化学习和优化来改进各种资源的分配战略。特别是,我们考虑一个问题,即中央控制者必须决定向何处发送测试包以了解世界不确定状态(积极学习);然后,利用新信息来建立关于各州的信念,并决定如何分配资源。我们提出了一个通用模式,同时提出在对世界状况不完全了解的情况下作出疫苗分配决策的金枪鱼易长型政策。长型政策与基于人口的近视政策相比较,后者更有可能与现行战略相类似。每个疫苗分配政策都与测试包分配政策配合,以积极学习。我们的模拟结果表明,基于优化的长型决策战略将超越所提出的近视政策。