This paper describes the ongoing development of a conversational interaction concept that allows visually impaired users to easily create and edit text documents on mobile devices using mainly voice input. In order to verify the concept, a prototype app was developed and tested for both iOS and Android systems, based on the natural-language understanding (NLU) platform Google Dialogflow. The app and interaction concept were repeatedly tested by users with and without visual impairments. Based on their feedback, the concept was continuously refined, adapted and improved on both mobile platforms. In an iterative user-centred design approach, the following research questions were investigated: Can a visually impaired user rely mainly on speech commands to efficiently create and edit a document on mobile devices? User testing found that an interaction concept based on conversational speech commands was easy and intuitive for visually impaired users. However, it was also found that relying on speech commands alone created its own obstacles, and that a combination of gestures and voice interaction would be more robust. Future research and more extensive useability tests should be carried out among visually impaired users in order to optimize the interaction concept.
翻译:本文介绍正在开发的谈话互动概念,使视障用户能够方便地使用主要语音输入在移动设备上创建和编辑文本文件。为了核实这一概念,在自然语言理解平台Google Dialogproll的基础上,为iOS和Android系统开发并测试了原型应用程序。应用程序和互动概念由有视觉障碍和没有视觉障碍的用户反复测试。根据他们的反馈,这两个移动平台上的概念都在不断完善、调整和改进。在以用户为中心的迭代设计方法中,调查了以下研究问题:视障用户能否主要依靠语音指令高效率地创建和编辑移动设备文件?用户测试发现,基于语音指令的互动概念对视障用户来说是容易和不直觉的。然而,还发现单靠语音指令本身就会产生障碍,而且将手势和语音互动结合起来将更加有力。在视觉受损用户之间开展未来研究和更广泛的使用测试,以便优化互动概念。