地址：https://zhuanlan.zhihu.com/p/430479546
NeurIPS-2021刚刚放榜没多久，笔者为了进一步优化推荐系统，就因果推断方向，总结了今年NIPS相关的一些论文。因果推断以及因果发现等是未来推荐系统进化以及增长的一个强大的数据挖掘武器，如果能够有效利用因果推断能力，能够为推荐系统的生态良性和实质增长贡献可靠能力。以下是本人整理选取的十几篇今年NIPS因果相关专题的论文，涉及的因果细分方向有：
因果发现、因果结构学习、贝叶斯学习、因果强化学习、因果推断、因果深度学习、因果多任务学习、因果对抗学习。我个人认为比较有价值的文章，会标注相应的中文题目，欢迎大家浏览评论。
今年NIPS接受论文的List:
https://neurips.cc/Conferences/2021/Schedule?type=Poster
因果发现是通过对相关数据进行算法发掘，从而提取因果关系。这在推荐系统的数据分析中十分重要，尤其是特征分析、效果分析。是增长模型的利器，未来需要重点关注。
Iterative Causal Discovery in the Possible Presence of Latent Confounders and Selection Bias
Raanan Yehezkel Rohekar (Intel Labs) · Shami Nisimov (Intel Labs) · Yaniv Gurwicz (Intel Labs) · Gal Novik (Intel Labs)
Reliable Causal Discovery with Improved Exact Search and Weaker Assumptions
Ignavier Ng (Carnegie Mellon University) · Yujia Zheng (Carnegie Mellon University) · Jiji Zhang (Lingnan University) · Kun Zhang (CMU)
Collaborative Causal Discovery with Atomic Interventions
Raghavendra Addanki (College of Information and Computer Science, University of Massachusetts, Amherst) · Shiva Kasiviswanathan (Amazon)
BCD Nets: Scalable Variational Approaches for Bayesian Causal Discovery
Chris Cundy (Stanford University) · Aditya Grover (University of California, Los Angeles) · Stefano Ermon (Stanford)
因果结构学习本质上是通过拓扑结构来描述因果关系，从而更好地从不同尺度来反映因果关系的强度。落地有推荐场景的根因分析，特征有效性根因分析等，因果结构学习是一个重要的方向。
Interventional Sum-Product Networks: Causal Inference with Tractable Probabilistic Models
Matej Zečević (TU Darmstadt) · Devendra Dhami (CS Department, TU Darmstadt, TU Darmstadt) · Athresh Karanam (University of Texas, Dallas) · Sriraam Natarajan (Indiana University) · Kristian Kersting (TU Darmstadt)
Matching a Desired Causal State via Shift Interventions
Vicky Zhang (Massachusetts Institute of Technology) · Chandler Squires (Massachusetts Institute of Technology) · Caroline Uhler (Massachusetts Institute of Technology)
Necessary and sufficient graphical conditions for optimal adjustment sets in causal graphical models with hidden variables
Jakob Runge (German Aerospace Center)
具有隐藏变量的因果图模型中最优平差集的充分必要图条件
Instance-dependent Label-noise Learning under a Structural Causal Model
Yu Yao (University of Sydney) · Tongliang Liu (The University of Sydney) · Mingming Gong (University of Melbourne) · Bo Han (HKBU / RIKEN) · Gang Niu (RIKEN) · Kun Zhang (CMU)
结构因果模型下的实例依赖标记噪声学习
Causal Effect Inference for Structured Treatments
Jean Kaddour (University College London) · Yuchen Zhu (University College London) · Qi Liu (University of Oxford) · Matt Kusner (University College London) · Ricardo Silva (ucl.ac.uk)
Learning Causal Semantic Representation for Out-of-Distribution Prediction
Chang Liu (Microsoft Research Asia) · Xinwei Sun (Peking University) · Jindong Wang (Microsoft Research Asia) · Haoyue Tang (Tsinghua University, Tsinghua University) · Tao Li (Peking University) · Tao Qin (Microsoft Research) · Wei Chen (Microsoft Research) · Tie-Yan Liu (Microsoft Research)
Recursive Causal Structure Learning in the Presence of Latent Variables and Selection Bias
Sina Akbari (EPFL (École Polytechnique Fédérale de Lausanne)) · Ehsan Mokhtarian (Swiss Federal Institute of Technology Lausanne) · AmirEmad Ghassami (Johns Hopkins University) · Negar Kiyavash (École Polytechnique Fédérale de Lausanne)
Learning latent causal graphs via mixture oracles
Bohdan Kivva (University of Chicago) · Goutham Rajendran (University of Chicago) · Pradeep Ravikumar (Carnegie Mellon University) · Bryon Aragam (University of Chicago)
A Causal Lens for Controllable Text Generation
Zhiting Hu (Carnegie Mellon University) · Li Erran Li (AWS AI, Amazon)
Statistical Undecidability in Linear, Non-Gaussian Causal Models in the Presence of Latent Confounders
Konstantin Genin (University of Tübingen)
Identification of Partially Observed Linear Causal Models: Graphical Conditions for the Non-Gaussian and Heterogeneous Cases
Jeffrey Adams (University of Copenhagen) · Niels Hansen (University of Copenhagen) · Kun Zhang (CMU)
Answering Complex Causal Queries With the Maximum Causal Set Effect
贝叶斯是因果方向的一种基础工具。借此，我们可以为我们的方法找到理论依据和优化工具。
Dynamic Causal Bayesian Optimization
Virginia Aglietti (University of Warwick) · Neil Dhir (Alan Turing Institute) · Javier González (Microsoft Research Cambridge) · Theodoros Damoulas (University of Warwick)
BayesIMP: Uncertainty Quantification for Causal Data Fusion
Siu Lun Chau (University of Oxford) · Jean-Francois Ton (University of Oxford) · Javier González (Microsoft Research Cambridge) · Yee Teh (DeepMind) · Dino Sejdinovic (University of Oxford)
强化学习和因果关系的结合是一个较热的方向，也是强化学习当中反对大规模数据暴力强化学习的有力理论支撑。我本人同样反对暴力强化学习，既只依赖数据规模、数据多样性就能依靠现有深度学习方法解决强化学习场景的问题。
Actively Identifying Causal Effects with Latent Variables Given Only Response
Causal Bandits with Unknown Graph Structure
Yangyi Lu (University of Michigan) · Amirhossein Meisami (University of Michigan) · Ambuj Tewari (University of Michigan)
通过具有未知图结构的因果器来积极识别潜在变量的因果效应
Provably Efficient Causal Reinforcement Learning with Confounded Observational Data
Lingxiao Wang (Northwestern University) · Zhuoran Yang (Princeton) · Zhaoran Wang (Princeton University)
Asymptotically Best Causal Effect Identification with Multi-Armed Bandits
Alan Malek (DeepMind) · Silvia Chiappa (DeepMind)
Deep Proxy Causal Learning and its Application to Confounded Bandit Policy Evaluation
Liyuan Xu (Gatsby Computational Neuroscience Unit) · Heishiro Kanagawa (Gatsby Unit, University College London) · Arthur Gretton (Gatsby Unit, UCL)
这个方向是因果推断方向，相对基础的方向，比较侧重于数据本身与因果的关系。
Causal Identification with Matrix Equations
Sanghack Lee (Penn State University) · Elias Bareinboim (Columbia University)
Recovering Latent Causal Factor for Generalization to Distributional Shifts
Xinwei Sun (Peking University) · Botong Wu (Peking University) · Xiangyu Zheng (Peking University) · Chang Liu (Microsoft Research Asia) · Wei Chen (Microsoft Research) · Tao Qin (Microsoft Research) · Tie-Yan Liu (Microsoft Research)
Actively Identifying Causal Effects with Latent Variables Given Only Response Variable Observable
Tian-Zuo Wang (Nanjing University) · Zhi-Hua Zhou (Nanjing University)
Matching a Desired Causal State via Shift Interventions
Vicky Zhang (Massachusetts Institute of Technology) · Chandler Squires (Massachusetts Institute of Technology) · Caroline Uhler (Massachusetts Institute of Technology)
A Critical Look at the Consistency of Causal Estimation with Deep Latent Variable Models
Severi Rissanen (Aalto University) · Pekka Marttinen (Aalto University)
DECAF: Generating Fair Synthetic Data Using Causally-Aware Generative Networks
Boris van Breugel (University of Cambridge) · Trent Kyono (UCLA) · Jeroen Berrevoets (University of Cambridge) · Mihaela van der Schaar (University of Cambridge)
MIRACLE: Causally-Aware Imputation via Learning Missing Data Mechanisms
Trent Kyono (UCLA) · Yao Zhang (University of Cambridge) · Alexis Bellot (Columbia University) · Mihaela van der Schaar (University of Cambridge)
Sequential Causal Imitation Learning with Unobserved Confounders
Daniel Kumor (Purdue University) · Junzhe Zhang (Columbia University) · Elias Bareinboim (Columbia University)
Invariant Causal Imitation Learning for Generalizable Policies
Ioana Bica (University of Oxford) · Daniel Jarrett (University of Cambridge) · Mihaela van der Schaar (University of Cambridge)
Learning Generalized Gumbel-max Causal Mechanisms
Guy Lorberbom (Technion) · Daniel Johnson (Google Research, Brain Team) · Chris Maddison (Oxford) · Daniel Tarlow (Microsoft Research Cambridge) · Tamir Hazan (Technion)
Object-Aware Regularization for Addressing Causal Confusion in Imitation Learning
Jongjin Park (KAIST) · Younggyo Seo (KAIST) · Chang Liu (Microsoft Research Asia) · Li Zhao (Microsoft Research) · Tao Qin (Microsoft Research) · Jinwoo Shin (KAIST) · Tie-Yan Liu (Microsoft Research)
通过深度学习方法来解决因果相关问题，也是近年因果问题的主流做法。
Comprehensive Knowledge Distillation with Causal Intervention
Xiang Deng (State University of New York at Binghamton) · Zhongfei Zhang (Binghamton University)
Causal Abstractions of Neural Networks
Atticus Geiger (Stanford University) · Hanson H Lu (Stanford University) · Thomas F Icard (Stanford University) · Christopher Potts (Stanford University)
How Well do Feature Visualizations Support Causal Understanding of CNN Activations?
Roland S. Zimmermann (University of Tübingen, International Max Planck Research School for Intelligent Systems) · Judy Borowski (University of Tuebingen) · Robert Geirhos (University of Tübingen) · Matthias Bethge (University of Tübingen) · Thomas Wallis (TU Darmstadt) · Wieland Brendel (AG Bethge, University of Tübingen)
Causal Navigation by Continuous-time Neural Networks
Charles J Vorbach (Massachusetts Institute of Technology) · Ramin Hasani (MIT) · Alexander Amini (MIT) · Mathias Lechner (IST Austria) · Daniela Rus (Massachusetts Institute of Technology)
Causal Inference for Event Pairs in Multivariate Point Processes
Tian Gao (IBM Research AI) · Dharmashankar Subramanian (IBM Research) · Debarun Bhattacharjya (IBM Research) · Xiao Shou (Rensselaer Polytechnic Institute) · Nicholas Mattei (Tulane University) · Kristin P Bennett (Rensselaer Poly. Inst.)
A Topological Perspective on Causal Inference
Duligur Ibeling (Stanford University) · Thomas F Icard (Stanford University)
Causal Influence Detection for Improving Efficiency in Reinforcement Learning
Maximilian Seitzer (Max Planck Institute for Intelligent Systems, Max-Planck Institute) · Bernhard Schölkopf (MPI for Biological Cybernetics) · Georg Martius (IST Austria)
The Causal-Neural Connection: Expressiveness, Learnability, and Inference
Kevin M Xia (Columbia University) · Kai-Zhan Lee (Columbia University) · Yoshua Bengio (University of Montreal) · Elias Bareinboim (Columbia University)
机器学习的对抗场景无处不在，因果推断场景也不例外。因果学习对对抗数据的敏感度更高，很容易出现因果翻转的现象，这是我们利用因果工具的时候，尤其要注意的。
Beware of the Simulated DAG! Causal Discovery Benchmarks May Be Easy to Game
Alexander Reisach (University of Amsterdam) · Christof Seiler (Maastricht University) · Sebastian Weichwald (University of Copenhagen)
多任务学习是推荐系统场景中经常要面对的问题，借助因果工具来进行多任务学习是一个不错的尝试。
Multi-task Learning of Order-Consistent Causal Graphs
Xinshi Chen (Georgia Institution of Technology) · Haoran Sun (Georgia Institute of Technology) · Caleb Ellington (School of Computer Science, Carnegie Mellon University) · Eric Xing (Petuum Inc. / Carnegie Mellon University) · Le Song (Georgia Institute of Technology)
微信扫码咨询专知VIP会员