Clustering Text has been an important problem in the domain of Natural Language Processing. While there are techniques to cluster text based on using conventional clustering techniques on top of contextual or non-contextual vector space representations, it still remains a prevalent area of research possible to various improvements in performance and implementation of these techniques. This paper discusses a novel technique to cluster text using attention mechanisms. Attention Mechanisms have proven to be highly effective in various NLP tasks in recent times. This paper extends the idea of attention mechanism in clustering space and sheds some light on a whole new area of research
翻译:集群文本是自然语言处理领域的一个重要问题,虽然在使用上下文或非外文矢量空间代表面外的常规集群技术的基础上,存在着将案文分组的技术,但对于改进这些技术的性能和实施方面的各种改进来说,它仍然是可能进行广泛研究的一个领域。本文讨论了利用注意机制对集群文本进行分组的一种新技术。最近,注意机制在各种国家劳工规划任务中证明非常有效。本文件扩展了集群空间的注意机制概念,并对整个新的研究领域作了一些介绍。