Can machine learning help us make better decisions about a changing planet? In this paper, we illustrate and discuss the potential of a promising corner of machine learning known as _reinforcement learning_ (RL) to help tackle the most challenging conservation decision problems. RL is uniquely well suited to conservation and global change challenges for three reasons: (1) RL explicitly focuses on designing an agent who _interacts_ with an environment which is dynamic and uncertain, (2) RL approaches do not require massive amounts of data, (3) RL approaches would utilize rather than replace existing models, simulations, and the knowledge they contain. We provide a conceptual and technical introduction to RL and its relevance to ecological and conservation challenges, including examples of a problem in setting fisheries quotas and in managing ecological tipping points. Four appendices with annotated code provide a tangible introduction to researchers looking to adopt, evaluate, or extend these approaches.
翻译:机器学习能帮助我们对变化中的地球做出更好的决定吗?在本文中,我们说明并讨论一个充满希望的机器学习角落,即_加强学习_(RL)的潜力,以帮助解决最具挑战性的养护决定问题。RL特别适合养护和全球变化的挑战,原因有三:(1)RL明确侧重于设计一个在动态和不确定的环境中进行_互动_的代理商;(2)RL方法不需要大量的数据;(3)RL方法将利用而不是取代现有的模型、模拟和它们所包含的知识。我们对RL及其与生态和养护挑战的相关性进行概念和技术介绍,包括在确定渔业配额和管理生态临界点方面存在问题的例子。附加说明代码的四种附录为寻求采用、评价或推广这些方法的研究人员提供了切实的介绍。