As shared, collaborative, networked, virtual environments become increasingly popular, various challenges arise regarding the efficient transmission of model and scene transformation data over the network. As user immersion and real-time interactions heavily depend on VR stream synchronization, transmitting the entire data sat does not seem a suitable approach, especially for sessions involving a large number of users. Session recording is another momentum-gaining feature of VR applications that also faces the same challenge. The selection of a suitable data format can reduce the occupied volume, while it may also allow effective replication of the VR session and optimized post-processing for analytics and deep-learning algorithms. In this work, we propose two algorithms that can be applied in the context of a networked multiplayer VR session, to efficiently transmit the displacement and orientation data from the users' hand-based VR HMDs. Moreover, we present a novel method describing effective VR recording of the data exchanged in such a session. Our algorithms, based on the use of dual-quaternions and multivectors, impact the network consumption rate and are highly effective in scenarios involving multiple users. By sending less data over the network and interpolating the in-between frames locally, we manage to obtain better visual results than current state-of-the-art methods. Lastly, we prove that, for recording purposes, storing less data and interpolating them on-demand yields a data set quantitatively close to the original one.
翻译:由于共享、协作、网络化、虚拟环境越来越受欢迎,在网络上有效传输模型和场景转换数据方面出现了各种挑战。由于用户沉浸和实时互动在很大程度上依赖于VR流同步,因此传送全部数据似乎不是一种合适的方法,特别是涉及大量用户的会话。会议记录是VR应用程序中另一个也面临相同挑战的动力增益特点。选择合适的数据格式可以减少所占用的数量,同时它也可以允许有效复制VR会话和优化后处理,用于分析和深层学习算法。在这项工作中,我们提出两种算法,在网络多功能的多功能VR会话中可以应用,以有效传输用户手持VR HMD的迁移和定向数据。此外,我们提出了一个新的方法,说明VR对在这样的会中交换的数据的有效记录。我们基于双向和多功能的算法,影响网络消费率,并在涉及多个用户的情景中非常有效。我们通过发送较不那么先进的数据,在网络上和不同层次之间获取比我们更接近的数据,从而在最接近的图像上改进了我们获取的数据,从而在网络和最接近的图像上更接近的数据。