In this paper, we propose a distortion-aware loop filtering model to improve the performance of intra coding for 360$^o$ videos projected via equirectangular projection (ERP) format. To enable the awareness of distortion, our proposed module analyzes content characteristics based on a coding unit (CU) partition mask and processes them through partial convolution to activate the specified area. The feature recalibration module, which leverages cascaded residual channel-wise attention blocks (RCABs) to adjust the inter-channel and intra-channel features automatically, is capable of adapting with different quality levels. The perceptual geometry optimization combining with weighted mean squared error (WMSE) and the perceptual loss guarantees both the local field of view (FoV) and global image reconstruction with high quality. Extensive experimental results show that our proposed scheme achieves significant bitrate savings compared with the anchor (HM + 360Lib), leading to 8.9%, 9.0%, 7.1% and 7.4% on average bit rate reductions in terms of PSNR, WPSNR, and PSNR of two viewports for luminance component of 360^o videos, respectively.
翻译:在本文中,我们提出一个扭曲觉察环路过滤模型,以提高通过正方形投影(ERP)格式预测的360美元视频的内部编码性能。为了能够了解扭曲情况,我们提议的模块根据编码单位(CU)分区遮罩分析内容特性,并通过部分变换处理这些特性以激活指定区域。功能校正模块,利用级联的剩余通道关注区块(RCABs)自动调整频道间和频道内功能,能够适应不同质量水平。概念几何优化结合加权平均正方差(WMSE)和概念损失保证了当地视域(FOV)和高质量的全球图像重建。广泛的实验结果表明,我们拟议的方案与锚(HM+360Lib)相比,实现了显著的比特率节约,在PSNR、WPSNR和PSNR的平均比值下降8.9%、9.0%、7.1%和7.4%7.4%。