Video frame interpolation (VFI) is a fundamental research topic in video processing, which is currently attracting increased attention across the research community. While the development of more advanced VFI algorithms has been extensively researched, there remains little understanding of how humans perceive the quality of interpolated content and how well existing objective quality assessment methods perform when measuring the perceived quality. In order to narrow this research gap, we have developed a new video quality database named BVI-VFI, which contains 540 distorted sequences generated by applying five commonly used VFI algorithms to 36 diverse source videos with various spatial resolutions and frame rates. We collected more than 10,800 quality ratings for these videos through a large scale subjective study involving 189 human subjects. Based on the collected subjective scores, we further analysed the influence of VFI algorithms and frame rates on the perceptual quality of interpolated videos. Moreover, we benchmarked the performance of 28 classic and state-of-the-art objective image/video quality metrics on the new database, and demonstrated the urgent requirement for more accurate bespoke quality assessment methods for VFI. To facilitate further research in this area, we have made BVI-VFI publicly available at https://github.com/danielism97/BVI-VFI-database.
翻译:视频框架间插(VFI)是视频处理的一个基本研究课题,目前正在引起整个研究界的更多关注。虽然已经对开发更先进的VFI算法进行了广泛的研究,但对于人们如何看待内插内容的质量,以及衡量所觉察的质量时现有客观质量评估方法的运作情况,仍然缺乏了解。为了缩小这一研究差距,我们开发了一个名为BVI-VFI的新的视频质量数据库,其中载有540个扭曲的序列,该数据库将VFI的540个常用算法应用于36个不同来源的有各种空间分辨率和框架率的视频。我们通过涉及189个人类主题的大规模主观研究,为这些视频收集了10 800多个质量评级。我们根据收集到的主观评分,进一步分析了VFIA的算法和框架率对内插视频的认知质量的影响。此外,我们还在新的数据库上对28种经典和最先进的客观图像/图像质量度进行了基准,并表明迫切需要为VFIFI提供更准确的质量评估方法。我们为这一领域的进一步研究提供了BVI-VIAVI/FIA/公证。我们已把AVI-FIAVI/FIAL/FIA/FIA/ADIS/ADADADIS/A/ADIS/ADIS/ADI/ADI/ADIS/ADIFIAR