With the increased interest in machine learning, and deep learning in particular, the use of automatic differentiation has become more wide-spread in computation. There have been two recent developments to provide the theoretical support for this types of structure. One approach, due to Abadi and Plotkin, provides a simple differential programming language. Another approach is the notion of a reverse differential category. In the present paper we bring these two approaches together. In particular, we show how an extension of reverse derivative categories models Abadi and Plotkin's language, and describe how this categorical model allows one to consider potential improvements to the operational semantics of the language.
翻译:随着对机器学习的兴趣增加,特别是深思熟虑,自动差别化的使用在计算中已变得更加广泛,最近出现了两个事态发展,为这种类型的结构提供理论支持,一种是阿巴迪和普洛特金的方法,一种是简单的差别化编程语言,另一种是反向差别分类的概念,在本文件中,我们把这两种方法结合起来,特别是,我们展示了反向衍生类模式阿巴迪和普洛特金语言的扩展,并描述了这一绝对模式如何允许人们考虑对语言的操作语义进行可能的改进。