Events across a timeline are a common data representation, seen in different temporal modalities. Individual atomic events can occur in a certain temporal ordering to compose higher level composite events. Examples of a composite event are a patient's medical symptom or a baseball player hitting a home run, caused distinct temporal orderings of patient vitals and player movements respectively. Such salient composite events are provided as labels in temporal datasets and most works optimize models to predict these composite event labels directly. We focus on uncovering the underlying atomic events and their relations that lead to the composite events within a noisy temporal data setting. We propose Neural Temporal Logic Programming (Neural TLP) which first learns implicit temporal relations between atomic events and then lifts logic rules for composite events, given only the composite events labels for supervision. This is done through efficiently searching through the combinatorial space of all temporal logic rules in an end-to-end differentiable manner. We evaluate our method on video and healthcare datasets where it outperforms the baseline methods for rule discovery.
翻译:不同时间模式的单个原子事件可以在某个时间顺序下发生,以形成更高层次的复合事件。复合事件的例子有病人的医学症状或棒球运动员打全垒打,分别造成病人生命和玩家运动的不同时间顺序。这些突出的复合事件在时间数据集中以标签形式提供,大多数都优化了直接预测这些复合事件标签的模型。我们侧重于发现在噪音的时间数据设置中导致复合事件的基本原子事件及其关系。我们建议神经时空逻辑编程(Neoral TLP)首先学习原子事件之间的隐性时间关系,然后在仅考虑到综合事件标签的情况下,提升复合事件的逻辑规则。这是通过以最终到最终不同的方式有效搜索所有时间逻辑规则的组合空间来完成的。我们评估了视频和保健数据集的方法,因为其比规则发现的基准方法要差强。