The transductive inference is an effective technique in the few-shot learning task, where query sets update prototypes to improve themselves. However, these methods optimize the model by considering only the classification scores of the query instances as confidence while ignoring the uncertainty of these classification scores. In this paper, we propose a novel method called Uncertainty-Based Network, which models the uncertainty of classification results with the help of mutual information. Specifically, we first data augment and classify the query instance and calculate the mutual information of these classification scores. Then, mutual information is used as uncertainty to assign weights to classification scores, and the iterative update strategy based on classification scores and uncertainties assigns the optimal weights to query instances in prototype optimization. Extensive results on four benchmarks show that Uncertainty-Based Network achieves comparable performance in classification accuracy compared to state-of-the-art method.
翻译:转基因推论是微小的学习任务中的一种有效技术,在这种任务中,查询组更新了原型,以自我改进;然而,这些方法优化了模型,仅将查询的分类分数视为信任度,而忽略了分类分数的不确定性。在本文中,我们提出了一种叫作不确定性网络的新颖方法,在相互信息的帮助下对分类结果的不确定性进行模型分析。具体地说,我们首先对查询实例进行数据扩充和分类,并计算这些分类分数的相互信息。然后,将相互信息作为确定分类分数权重的不确定性加以使用,而基于分类分数和不确定性的迭代更新战略则给原型优化的查询案例分配了最佳的权重。 关于四个基准的广泛结果显示,不确定性网络在分类准确性方面达到与最新方法的相似性。