Intelligent assistive systems can navigate blind people, but most of them could only give non-intuitive cues or inefficient guidance. Based on computer vision and vibrotactile encoding, this paper presents an interactive system that provides blind people with intuitive spatial cognition. Different from the traditional auditory feedback strategy based on speech cues, this paper firstly introduces a vibration-encoded feedback method that leverages the haptic neural pathway and enables the users to interact with objects other than manipulating an assistance device. Based on this strategy, a wearable visual module based on an RGB-D camera is adopted for 3D spatial object localization, which contributes to accurate perception and quick object localization in the real environment. The experimental results on target blind individuals indicate that vibrotactile feedback reduces the task completion time by over 25% compared with the mainstream voice prompt feedback scheme. The proposed object localization system provides a more intuitive spatial navigation and comfortable wearability for blindness assistance.
翻译:智能辅助系统可以引导盲人, 但大部分只能提供非直观的提示或低效指导。 基于计算机视觉和振动活性编码, 本文展示了一个互动系统, 向盲人提供直观的空间认知。 与传统的语音提示反馈战略不同, 本文首先引入了振动编码反馈方法, 利用机能神经路径, 让用户能够与除操纵辅助设备以外的对象互动。 基于此战略, 3D 空间对象本地化采用了基于 RGB- D 相机的可磨损视觉模块, 这有助于准确的感知和在真实环境中快速定位。 对目标盲人的实验结果表明, 振动活性反馈比主流语音提示反馈计划减少了25%以上的任务完成时间。 拟议的天体定位系统提供了更直观的空间导航, 并且方便失明援助的耗损性。