One of the challenges in text generation is to control generation as intended by a user. Previous studies have proposed to specify the keywords that should be included in the generated text. However, this is insufficient to generate text which reflect the user intent. For example, placing the important keyword beginning of the text would helps attract the reader's attention, but existing methods do not enable such flexible control. In this paper, we tackle a novel task of controlling not only keywords but also the position of each keyword in the text generation. To this end, we show that a method using special tokens can control the relative position of keywords. Experimental results on summarization and story generation tasks show that the proposed method can control keywords and their positions. We also demonstrate that controlling the keyword positions can generate summary texts that are closer to the user's intent than baseline. We release our code.
翻译:在文本生成中,面临的一个挑战是按照用户的意愿进行生成。先前的研究提出了指定应包含在生成文本中的关键词的方法。然而,这种方法无法生成反映用户意图的文本。例如,将重要关键词放置在文本开头会有助于吸引读者的注意力,但现有方法不支持这种灵活的控制。在本文中,我们解决了一个新颖的任务,即控制文本生成中关键词的位置。为此,我们使用特殊标记的方法来控制关键词的相对位置。在摘要和故事生成任务上的实验结果表明,所提出的方法可以控制关键词和它们的位置。我们还展示了控制关键词位置可以生成比基线更接近用户意图的摘要文本。我们公开了我们的代码。