Salient human detection (SHD) in dynamic 360{\deg} immersive videos is of great importance for various applications such as robotics, inter-human and human-object interaction in augmented reality. However, 360{\deg} video SHD has been seldom discussed in the computer vision community due to a lack of datasets with large-scale omnidirectional videos and rich annotations. To this end, we propose SHD360, the first 360{\deg} video SHD dataset which contains various real-life daily scenes. Since so far there is no method proposed for 360{\deg} image/video SHD, we systematically benchmark 11 representative state-of-the-art salient object detection (SOD) approaches on our SHD360, and explore key issues derived from extensive experimenting results. We hope our proposed dataset and benchmark could serve as a good starting point for advancing human-centric researches towards 360{\deg} panoramic data.
翻译:在动态360=deg}隐性视频中进行人类探测(SHD)对于机器人、人与人之间的相互作用和人体物体相互作用等各种应用都非常重要。然而,由于缺少带有大规模全向视频和丰富的说明的数据集,计算机视觉界很少讨论360=deg}视频SHD(SHD),我们希望我们提议的数据集和基准可以作为推动以人为中心的研究的好起点,以达到360=deg}全色数据。