In the analysis of stochastic dynamical systems described by stochastic differential equations (SDEs), it is often of interest to analyse the sensitivity of the expected value of a functional of the solution of the SDE with respect to perturbations in the SDE parameters. In this paper, we consider path functionals that depend on the solution of the SDE up to a stopping time. We derive formulas for Fr\'{e}chet derivatives of the expected values of these functionals with respect to bounded perturbations of the drift, using the Cameron-Martin-Girsanov theorem for the change of measure. Using these derivatives, we construct an example to show that the map that sends the change of drift to the corresponding relative entropy is not in general convex. We then analyse the existence and uniqueness of solutions to stochastic optimal control problems defined on possibly random time intervals, as well as gradient-based numerical methods for solving such problems.
翻译:在分析Stochestic 差分方程式(SDEs)所描述的随机动态系统时,分析SDE解决方案在SDE参数扰动方面的功能的预期值的敏感度往往很有意义。在本文中,我们考虑了取决于SDE解决方案直到停止时间的路径功能。我们用Cameron-Martin-Girsanov测算器来分析这些功能在漂移受捆绑干扰方面的预期值衍生物的公式。我们用这些衍生物构建了一个示例,以显示将漂移变化传送到相应相对的entropy的地图不是一般的 convex。然后我们分析了在可能随机间隔下定义的随机最佳控制问题解决方案的存在和独特性,以及解决这些问题的梯度数字方法。