BlenderBot 2.0 is a dialogue model that represents open-domain chatbots by reflecting real-time information and remembering user information for an extended period using an internet search module and multi-session. Nonetheless, the model still has room for improvement. To this end, we examine BlenderBot 2.0 limitations and errors from three perspectives: model, data, and user. From the data point of view, we highlight the unclear guidelines provided to workers during the crowdsourcing process, as well as a lack of a process for refining hate speech in the collected data and verifying the accuracy of internet-based information. From a user perspective, we identify nine types of limitations of BlenderBot 2.0, and their causes are thoroughly investigated. Furthermore, for each point of view, we propose practical improvement methods and discuss several potential future research directions.
翻译:BlenderBot 2. 0 是一个对话模式,它代表开放的聊天室,反映实时信息,用互联网搜索模块和多部分语言在很长一段时间内记住用户信息。然而,该模式仍有改进的余地。为此,我们从三个角度审视BlenderBot 2. 0 限制和错误:模型、数据和用户。从数据角度出发,我们强调在众包过程中向工人提供的不明确的指导方针,以及缺乏在收集的数据中改进仇恨言论和核实互联网信息准确性的程序。从用户的角度来看,我们确定了BlenderBot 2. 0 的九类限制及其原因,对此进行了彻底调查。此外,我们从每个角度提出切实可行的改进方法,并讨论若干潜在的未来研究方向。