Beyond Ads: Sequential Decision-Making Algorithms in Law and Public Policy

We explore the promises and challenges of employing sequential decision-making algorithms - such as bandits, reinforcement learning, and active learning - in law and public policy. While such algorithms have well-characterized performance in the private sector (e.g., online advertising), their potential in law and the public sector remains largely unexplored, due in part to distinct methodological challenges of the policy setting. Public law, for instance, can pose multiple objectives, necessitate batched and delayed feedback, and require systems to learn rational, causal decision-making policies, each of which presents novel questions at the research frontier. We highlight several applications of sequential decision-making algorithms in regulation and governance, and discuss areas for needed research to render such methods policy-compliant, more widely applicable, and effective in the public sector. We also note the potential risks of such deployments and describe how sequential decision systems can also facilitate the discovery of harms. We hope our work inspires more investigation of sequential decision making in law and public policy, which provide unique challenges for machine learning researchers with tremendous potential for social benefit.