Zero-shot cross-domain slot filling alleviates the data dependence in the case of data scarcity in the target domain, which has aroused extensive research. However, as most of the existing methods do not achieve effective knowledge transfer to the target domain, they just fit the distribution of the seen slot and show poor performance on unseen slot in the target domain. To solve this, we propose a novel approach based on prototypical contrastive learning with a dynamic label confusion strategy for zero-shot slot filling. The prototypical contrastive learning aims to reconstruct the semantic constraints of labels, and we introduce the label confusion strategy to establish the label dependence between the source domains and the target domain on-the-fly. Experimental results show that our model achieves significant improvement on the unseen slots, while also set new state-of-the-arts on slot filling task.
翻译:零点交叉空档填充减轻了目标领域数据稀缺情况下的数据依赖性,这引起了广泛的研究。然而,由于大多数现有方法没有实现向目标领域的有效知识转让,因此它们只是符合所看到空档的分布,在目标领域未见空档上表现不佳。为了解决这个问题,我们提出了基于原型对比学习的新办法,为零点填充采用动态标签混淆策略。原型对比学习旨在重建标签的语义限制,我们引入了标签混淆战略,以确定源域与目标域之间的标签依赖性。实验结果显示,我们的模型在未知空档上取得了显著改进,同时也为空档填充任务设定了新的最新条件。