We introduce Logic Guided Machine Learning (LGML), a novel approach that symbiotically combines machine learning (ML) and logic solvers with the goal of learning mathematical functions from data. LGML consists of two phases, namely a learning-phase and a logic-phase with a corrective feedback loop, such that, the learning-phase learns symbolic expressions from input data, and the logic-phase cross verifies the consistency of the learned expression with known auxiliary truths. If inconsistent, the logic-phase feeds back "counterexamples" to the learning-phase. This process is repeated until the learned expression is consistent with auxiliary truth. Using LGML, we were able to learn expressions that correspond to the Pythagorean theorem and the sine function, with several orders of magnitude improvements in data efficiency compared to an approach based on an out-of-the-box multi-layered perceptron (MLP).
翻译:我们引入了逻辑制导机器学习(LGML)这一新的方法,将机器学习(ML)和逻辑解算器与从数据中学习数学函数的目标相共生。 LGML由两个阶段组成,即学习阶段和逻辑阶段以及纠正反馈循环,这样学习阶段从输入数据中学习象征性的表达方式,而逻辑阶段交叉则验证所学表达方式与已知的辅助真理的一致性。如果不一致,逻辑阶段将“反剖面”反馈到学习阶段。在学习的表达方式与辅助真理一致之前,这一过程会重复进行。我们利用LGML学会学会了与Pytagorean理论和正弦函数相对应的表达方式,数据效率与基于外框多层感官(MLP)的方法相比有几级的幅度改进。