There exist well-developed frameworks for causal modelling, but these require rather a lot of human domain expertise to define causal variables and perform interventions. In order to enable autonomous agents to learn abstract causal models through interactive experience, the existing theoretical foundations need to be extended and clarified. Existing frameworks give no guidance regarding variable choice / representation, and more importantly, give no indication as to which behaviour policies or physical transformations of state space shall count as interventions. The framework sketched in this paper describes actions as transformations of state space, for instance induced by an agent running a policy. This makes it possible to describe in a uniform way both transformations of the micro-state space and abstract models thereof, and say when the latter is veridical / grounded / natural. We then introduce (causal) variables, define a mechanism as an invariant predictor, and say when an action can be viewed as a ``surgical intervention'', thus bringing the objective of causal representation & intervention skill learning into clearer focus.
翻译:现有框架没有就可变选择/代表方式提供指导,更重要的是,没有说明哪些行为政策或国家空间的物理变迁应算作干预措施。本文件所描述的框架将行动描述为国家空间的转变,例如由实施政策的代理人所引发的转变。这使得能够以统一的方式描述微型空间和抽象模型的变化,并说后者何时是天性/根基/自然的。然后我们引入(因果)变量,将一个机制确定为不变化预测器,并说当一项行动可被视为“表面干预”时,将因果关系和干预技能学习的目标置于更清晰的焦点。