As machine learning models are increasingly being employed to make consequential decisions in real-world settings, it becomes critical to ensure that individuals who are adversely impacted (e.g., loan denied) by the predictions of these models are provided with a means for recourse. While several approaches have been proposed to construct recourses for affected individuals, the recourses output by these methods either achieve low costs (i.e., ease-of-implementation) or robustness to small perturbations (i.e., noisy implementations of recourses), but not both due to the inherent trade-offs between the recourse costs and robustness. Furthermore, prior approaches do not provide end users with any agency over navigating the aforementioned trade-offs. In this work, we address the above challenges by proposing the first algorithmic framework which enables users to effectively manage the recourse cost vs. robustness trade-offs. More specifically, our framework Probabilistically ROBust rEcourse (\texttt{PROBE}) lets users choose the probability with which a recourse could get invalidated (recourse invalidation rate) if small changes are made to the recourse i.e., the recourse is implemented somewhat noisily. To this end, we propose a novel objective function which simultaneously minimizes the gap between the achieved (resulting) and desired recourse invalidation rates, minimizes recourse costs, and also ensures that the resulting recourse achieves a positive model prediction. We develop novel theoretical results to characterize the recourse invalidation rates corresponding to any given instance w.r.t. different classes of underlying models (e.g., linear models, tree based models etc.), and leverage these results to efficiently optimize the proposed objective. Experimental evaluation with multiple real world datasets demonstrate the efficacy of the proposed framework.
翻译:由于越来越多地使用机器学习模型在现实世界环境中做出相应决定,因此确保向因预测这些模型而受到不利影响的个人(例如,贷款被拒绝)提供追索手段变得至关重要。虽然提出了几种办法为受影响的个人建立追索手段,但采用这些方法的追索产出要么达到低成本(即,执行的容易程度),要么对小扰动(即,追索方式的不规则实施)的稳健度(即,追索成本与稳健性之间固有的权衡取舍。此外,以往的办法并没有为最终使用者提供任何机构来取代上述权衡取舍。此外,在这项工作中,我们通过提出第一个算法框架,使用户能够同时管理追索费用,与稳健性权衡取价。更具体地说,我们的框架以稳健性方式(即,执行不规则的模型)或对小扰动性干扰(即执行不稳性实施),让用户选择追索权的概率(直线性率率),如果对追索权进行小改动,则以新的追索费率作为结果。