Few-shot Learning has been studied to mimic human visual capabilities and learn effective models without the need of exhaustive human annotation. Even though the idea of meta-learning for adaptation has dominated the few-shot learning methods, how to train a feature extractor is still a challenge. In this paper, we focus on the design of training strategy to obtain an elemental representation such that the prototype of each novel class can be estimated from a few labeled samples. We propose a two-stage training scheme, Partner-Assisted Learning (PAL), which first trains a partner encoder to model pair-wise similarities and extract features serving as soft-anchors, and then trains a main encoder by aligning its outputs with soft-anchors while attempting to maximize classification performance. Two alignment constraints from logit-level and feature-level are designed individually. For each few-shot task, we perform prototype classification. Our method consistently outperforms the state-of-the-art method on four benchmarks. Detailed ablation studies of PAL are provided to justify the selection of each component involved in training.
翻译:在本文中,我们侧重于设计培训战略,以获得元素代表,使每个小类的原型可以从几个贴标签的样本中估算出来。我们提议了一个两阶段培训计划,即伙伴辅助学习(PAL),首先培训伙伴编码器,以模拟对称相似之处和提取特征,作为软锁定器,然后再培训一个主编码器,使其产出与软锁定器保持一致,同时尽量提高分类性能。对日志级别和特性级别的两个调整限制是单独设计的。对每个小类的任务,我们进行原型分类。我们的方法始终比四个基准的状态方法要快。对PAL进行详细的校正研究,以说明选择每个培训内容的理由。