We study few-shot learning in natural language domains. Compared to many existing works that apply either metric-based or optimization-based meta-learning to image domain with low inter-task variance, we consider a more realistic setting, where tasks are diverse. However, it imposes tremendous difficulties to existing state-of-the-art metric-based algorithms since a single metric is insufficient to capture complex task variations in natural language domain. To alleviate the problem, we propose an adaptive metric learning approach that automatically determines the best weighted combination from a set of metrics obtained from meta-training tasks for a newly seen few-shot task. Extensive quantitative evaluations on real-world sentiment analysis and dialog intent classification datasets demonstrate that the proposed method performs favorably against state-of-the-art few shot learning algorithms in terms of predictive accuracy. We make our code and data available for further study.
翻译:在自然语言领域,我们研究几近的学习。与许多现有的工作相比,我们考虑的是比较现实的环境,任务各不相同。然而,它给现有最先进的基于计量的算法带来了巨大的困难,因为单项指标不足以捕捉自然语言领域的复杂任务变化。为了缓解这一问题,我们建议采用适应性计量学习方法,从新发现的少数任务中从元培训任务中获得的一套衡量标准中自动确定最佳加权组合。关于现实世界情绪分析和对话意向分类数据集的广泛定量评价表明,拟议方法在预测准确性方面优于少数最先进的学习算法。我们提供了我们的代码和数据供进一步研究。