Intent detection with semantically similar fine-grained intents is a challenging task. To address it, we reformulate intent detection as a question-answering retrieval task by treating utterances and intent names as questions and answers. To that end, we utilize a question-answering retrieval architecture and adopt a two stages training schema with batch contrastive loss. In the pre-training stage, we improve query representations through self-supervised training. Then, in the fine-tuning stage, we increase contextualized token-level similarity scores between queries and answers from the same intent. Our results on three few-shot intent detection benchmarks achieve state-of-the-art performance.
翻译:为了解决这个问题,我们重新将意图探测作为问答检索任务,将语句和意向名称作为问答处理。为此,我们使用问答检索架构,采用分批对比损失的两阶段培训模式。在培训前阶段,我们通过自我监督培训改进查询表达方式。然后,在微调阶段,我们增加从同一意向查询和答复之间的背景化象征性相似度分数。我们在三个点数意向检测基准上的结果达到了最新业绩。</s>