In this paper we introduce PerPaDa, a Persian paraphrase dataset that is collected from users' input in a plagiarism detection system. As an implicit crowdsourcing experience, we have gathered a large collection of original and paraphrased sentences from Hamtajoo; a Persian plagiarism detection system, in which users try to conceal cases of text re-use in their documents by paraphrasing and re-submitting manuscripts for analysis. The compiled dataset contains 2446 instances of paraphrasing. In order to improve the overall quality of the collected data, some heuristics have been used to exclude sentences that don't meet the proposed criteria. The introduced corpus is much larger than the available datasets for the task of paraphrase identification in Persian. Moreover, there is less bias in the data compared to the similar datasets, since the users did not try some fixed predefined rules in order to generate similar texts to their original inputs.
翻译:在本文中,我们引入了PerPaDa,这是从用户输入的PerPaDa, 一个波斯方言数据集, 收集了用户输入的Pragirism探测系统。作为一种隐含的众包经验,我们收集了大量哈马塔朱的原始和原言句句;波斯方言探测系统,其中用户试图通过翻转和重新投递手稿来隐藏其文件中的文本再次使用的案例。 汇编的数据集包含2446个参数。 为了提高所收集数据的总体质量,一些超文本被用来排除不符合拟议标准的句子。 引入的文体比用于波斯方言识别任务的现有数据集要大得多。 此外,与类似的数据集相比,数据没有多少偏差,因为用户没有尝试某些固定的预设规则,以便产生与其原始投入相似的文字。