To provide users with more realistic visual experiences, videos are developing in the trends of Ultra High Definition (UHD), High Frame Rate (HFR), High Dynamic Range (HDR), Wide Color Gammut (WCG) and high clarity. However, the data amount of videos increases exponentially, which requires high efficiency video compression for storage and network transmission. Perceptually optimized video coding aims to maximize compression efficiency by exploiting visual redundancies. In this paper, we present a broad and systematic survey on perceptually optimized video coding. Firstly, we present problem formulation and framework of the perceptually optimized video coding, which includes visual perception modelling, visual quality assessment and perceptual video coding optimization. Secondly, recent advances on visual factors, computational perceptual models and quality assessment models are presented. Thirdly, we review perceptual video coding optimizations from four key aspects, including perceptually optimized bit allocation, rate-distortion optimization, transform and quantization, filtering and enhancement. In each part, problem formulation, working flow, recent advances, advantages and challenges are presented. Fourthly, perceptual coding performances of the latest coding standards and tools are experimentally analyzed. Finally, challenging issues and future opportunities are identified.
翻译：为了向用户提供更现实的视觉经验,录象正在以超高定义、高框架率、高动态距离、广彩色甘美(WCG)和高清晰度等趋势发展录象,然而,录象数据数量成倍增长,这要求存储和网络传输需要高效率的视频压缩; 认为最优化的录象编码的目的是通过利用视觉冗余来最大限度地提高压缩效率; 在本文中,我们介绍了对视觉优化视频编码的广泛和系统调查; 首先,我们介绍了概念优化视频编码的问题拟订和框架,其中包括视觉视觉观念建模、视觉质量评估和概念视频编码优化; 第二,介绍了视觉因素的最新进展、计算概念模型和质量评估模型。 第三,我们审查了四个关键方面的视觉调控调优化,包括概念优化的比分分配、率优化、转换和撤销、过滤和增强。 在每一个部分,问题拟订、工作流、最新进展、优势和挑战,提出了最新的视觉成型业绩标准,最后,还分析了最新的实验工具的形成机会。
相关内容
微信扫码咨询专知VIP会员