People with visual impairments urgently need helps, not only on the basic tasks such as guiding and retrieving objects , but on the advanced tasks like picturing the new environments. More than a guiding dog, they might want some devices which are able to provide linguistic interaction. Building on various research literature, we aim to conduct a research on the interaction between the robot agent and visual impaired people. The robot agent, applied VQA techniques, is able to analyze the environment, process and understand the pronouncing questions, and provide feedback to the human user. In this paper, we are going to discuss the related questions about this kind of interaction, the techniques we used in this work, and how we conduct our research.
翻译:视力障碍者迫切需要帮助, 不仅在引导和检索物体等基本任务上, 而且在想象新环境等高级任务上都需要帮助。 他们可能想要一些能够提供语言互动的装置, 不仅仅是一只指导狗。 我们以各种研究文献为基础, 旨在对机器人代理人和视力障碍者之间的互动进行研究。 应用VQA技术的机器人代理人能够分析环境、 过程和理解发音问题, 并向人类用户提供反馈。 在本文中, 我们将讨论关于这种互动的相关问题, 我们在这项工作中使用的技术, 以及如何进行研究 。