This work introduces a data-driven control approach for stabilizing high-dimensional dynamical systems from scarce data. The proposed context-aware controller inference approach is based on the observation that controllers need to act locally only on the unstable dynamics to stabilize systems. This means it is sufficient to learn the unstable dynamics alone, which are typically confined to much lower dimensional spaces than the high-dimensional state spaces of all system dynamics and thus few data samples are sufficient to identify them. Numerical experiments demonstrate that context-aware controller inference learns stabilizing controllers from orders of magnitude fewer data samples than traditional data-driven control techniques and variants of reinforcement learning. The experiments further show that the low data requirements of context-aware controller inference are especially beneficial in data-scarce engineering problems with complex physics, for which learning complete system dynamics is often intractable in terms of data and training costs.
翻译:这项工作从稀缺数据中引入了稳定高维动态系统的数据驱动控制方法; 拟议的环境觉察控制器推断方法基于以下观察,即控制器需要仅在当地对不稳定动态采取行动,才能稳定系统;这意味着仅了解不稳定动态就足够了,因为不稳定动态通常局限于远低于所有系统动态的高维状态空间,因此,数据样本很少足以识别这些动态; 数字实验表明,环境觉察控制器推断从数量级中学习稳定控制器,而数据样本少于传统的数据驱动控制技术和强化学习的变异。 实验还进一步表明,环境觉察控制器的低数据要求对于复杂物理学的数据跟踪工程问题特别有益,因为了解完整的系统动态往往在数据和训练费用方面难以解决。