Recent years have witnessed a rapid development of immersive multimedia which bridges the gap between the real world and virtual space. Volumetric videos, as an emerging representative 3D video paradigm that empowers extended reality, stand out to provide unprecedented immersive and interactive video watching experience. Despite the tremendous potential, the research towards 3D volumetric video is still in its infancy, relying on sufficient and complete datasets for further exploration. However, existing related volumetric video datasets mostly only include a single object, lacking details about the scene and the interaction between them. In this paper, we focus on the current most widely used data format, point cloud, and for the first time release a full-scene volumetric video dataset that includes multiple people and their daily activities interacting with the external environments. Comprehensive dataset description and analysis are conducted, with potential usage of this dataset. The dataset and additional tools can be accessed via the following website: https://cuhksz-inml.github.io/full_scene_volumetric_video_dataset/.
翻译:近年来,多媒体沉浸式技术极速发展,它将现实世界和虚拟空间之间的差距缩小。作为一种新兴的三维视频范例,提供了前所未有的沉浸式和交互式视频观看体验的体积视频备受瞩目。尽管有着巨大的潜力,但向三维视频的研究仍处于萌芽阶段,需要充分和完整的数据集来进一步探索。然而,现有的相关体积视频数据集大多仅包括单个对象,缺乏对场景和它们之间的交互细节的描述。在本文中,我们聚焦于目前使用最广泛的数据格式,即点云,并首次发布了包括多人和他们与外部环境互动的完整场景体积视频数据集。我们对数据集进行了全面的描述和分析,并探讨了该数据集的潜在用途。该数据集和附加工具可通过以下网站访问:https://cuhksz-inml.github.io/full_scene_volumetric_video_dataset/。