Omnidirectional images (ODIs), also known as 360-degree images, enable viewers to explore all directions of a given 360-degree scene from a fixed point. Designing an immersive imaging system with ODI is challenging as such systems require very large resolution coverage of the entire 360 viewing space to provide an enhanced quality of experience (QoE). Despite remarkable progress on single image super-resolution (SISR) methods with deep-learning techniques, no study for quality assessments of super-resolved ODIs exists to analyze the quality of such SISR techniques. This paper proposes an objective, full-reference quality assessment framework which studies quality measurement for ODIs generated by GAN-based and CNN-based SISR methods. The quality assessment framework offers to utilize tangential views to cope with the spherical nature of a given ODIs. The generated tangential views are distortion-free and can be efficiently scaled to high-resolution spherical data for SISR quality measurement. We extensively evaluate two state-of-the-art SISR methods using widely used full-reference SISR quality metrics adapted to our designed framework. In addition, our study reveals that most objective metric show high performance over CNN based SISR, while subjective tests favors GAN-based architectures.
翻译:尽管在采用深层学习技术的单一图像超分辨率方法方面取得了显著进展,但没有关于超解性ODI质量评估的研究来分析这类SISR技术的质量。本文件提出了一个客观、全面参考质量评估框架,用于研究GAN和CNNS的SISSR方法生成的ODI质量测量。质量评估框架提供了利用相近观点应对给定ODI的球状性质。所产生的相近观点是无扭曲的,可以有效地扩大到用于SISSR质量测量的高分辨率球状数据。我们利用广泛使用的完全参照性SISR质量衡量标准,广泛评价两种先进的SISR方法。此外,质量评估框架还展示了我们为基于高分辨率的IMIS框架而调整的高级性能测试。