Training machines to understand natural language and interact with humans is an elusive and essential task in the field of artificial intelligence. In recent years, a diversity of dialogue systems has been designed with the rapid development of deep learning researches, especially the recent pre-trained language models. Among these studies, the fundamental yet challenging part is dialogue comprehension whose role is to teach the machines to read and comprehend the dialogue context before responding. In this paper, we review the previous methods from the perspective of dialogue modeling. We summarize the characteristics and challenges of dialogue comprehension in contrast to plain-text reading comprehension. Then, we discuss three typical patterns of dialogue modeling that are widely-used in dialogue comprehension tasks such as response selection and conversation question-answering, as well as dialogue-related language modeling techniques to enhance PrLMs in dialogue scenarios. Finally, we highlight the technical advances in recent years and point out the lessons we can learn from the empirical analysis and the prospects towards a new frontier of researches.
翻译:理解自然语言和与人类互动的培训机器在人工智能领域是一项难以捉摸和必不可少的任务。近年来,设计了多种多样的对话系统,迅速发展了深层次的学习研究,特别是最近经过培训的语言模型。在这些研究中,根本但具有挑战性的部分是对话理解,其作用是教机器阅读和理解对话背景,然后做出回应。在本文件中,我们从对话模式的角度审视了以往的方法。我们总结了对话理解的特点和挑战,与纯文本阅读理解相对。然后,我们讨论了三种典型的对话模式,这些模式广泛用于对话理解任务,例如选择答复和回答问题,以及与对话有关的语言模型技术,以便在对话情景中加强普林尔姆斯。最后,我们强调近年来的技术进步,指出我们可以从经验分析中汲取的教训,以及探索新研究领域的前景。