We describe the AGReE system, which takes user-submitted passages as input and automatically generates grammar practice exercises that can be completed while reading. Multiple-choice practice items are generated for a variety of different grammar constructs: punctuation, articles, conjunctions, pronouns, prepositions, verbs, and nouns. We also conducted a large-scale human evaluation with around 4,500 multiple-choice practice items. We notice for 95% of items, a majority of raters out of five were able to identify the correct answer and for 85% of cases, raters agree that there is only one correct answer among the choices. Finally, the error analysis shows that raters made the most mistakes for punctuation and conjunctions.
翻译:我们描述AGREE系统,该系统将用户提交的段落作为输入,自动生成可在阅读时完成的语法练习;多种选择练习项目是为各种不同的语法构造生成的:标点、文章、连线、代名词、预设、动词和名词;我们还进行了大规模的人类评价,约4 500项多选练习项目;我们注意到95%的项目,5个中的大多数得分者能够确定正确的答案,85%的得分,评分者一致认为,选择中只有一个正确的答案。最后,错误分析显示,评级者为标码和联名做了最错误的错误。