We propose an approach to saddle point optimization relying only on an oracle that solves a minimization problem approximately. We analyze its convergence property on a strongly convex--concave problem and show its linear convergence toward the global min--max saddle point. Based on the convergence analysis, we propose a heuristic approach to adapt the learning rate for the proposed saddle point optimization approach. The implementation of the proposed approach using the (1+1)-CMA-ES as the minimization oracle, namely Adversarial-CMA-ES, is evaluated on test problems. Numerical evaluation reveals the tightness of the theoretical convergence rate bound as well as the efficiency of the learning rate adaptation mechanism. As an example of real-world applications, it is applied to automatic berthing control problems under model uncertainties, showing its usefulness in obtaining solutions robust under model uncertainties.
翻译:我们建议一种方法,即只依靠一个能大致解决尽量减少问题的神器来使点优化起步。我们分析其趋同特性,分析一个很强的精细结结晶问题,并显示其直线趋同到全球最小和最大马鞍点。根据趋同分析,我们提出一种超常方法,以调整拟议的马鞍点优化方法的学习率。用一个最小或最小的神器(1+1)-CMA-ES,即Aversarial-CMA-ES,来评估测试问题。数字评价显示,理论趋同率约束的紧紧性以及学习率适应机制的效率。作为现实世界应用的一个例子,它被用于在模型不确定性下自动避免控制问题,表明其在获得在模型不确定性下稳健的解决办法方面很有用。