Recently deep learning has been successfully applied to unsupervised active learning. However, current method attempts to learn a nonlinear transformation via an auto-encoder while ignoring the sample relation, leaving huge room to design more effective representation learning mechanisms for unsupervised active learning. In this paper, we propose a novel deep unsupervised Active Learning model via Learnable Graphs, named ALLG. ALLG benefits from learning optimal graph structures to acquire better sample representation and select representative samples. To make the learnt graph structure more stable and effective, we take into account $k$-nearest neighbor graph as a priori, and learn a relation propagation graph structure. We also incorporate shortcut connections among different layers, which can alleviate the well-known over-smoothing problem to some extent. To the best of our knowledge, this is the first attempt to leverage graph structure learning for unsupervised active learning. Extensive experiments performed on six datasets demonstrate the efficacy of our method.
翻译:最近深层次的学习被成功地应用于无人监督的积极学习。然而,目前的方法试图通过自动编码器学习非线性转换,而忽略抽样关系,留下巨大的空间来设计更有效的代表性学习机制,以便进行不受监督的积极学习。在本文中,我们提出一个新的深层次的、不受监督的积极学习模式,通过名为ALLG的可学习图形。ALLG从学习最佳图形结构以获得更好的样本代表性和选择有代表性的样本中受益。为了使所学的图形结构更加稳定和有效,我们把最近的相邻图作为先验图进行考虑,并学习一种关系传播图结构。我们还在不同的层中安装了捷径连接,这可以在某种程度上缓解众所周知的超移动问题。根据我们的知识,这是第一次尝试利用图形结构学习来进行不受监督的积极学习。在六个数据集上进行的广泛实验显示了我们方法的功效。