Textured Mesh Quality Assessment: Large-Scale Dataset and Deep Learning-based Quality metric

Over the past decade, 3D graphics have become highly detailed to mimic the real world, exploding their size and complexity and making them subject to lossy processing operations that may degrade their visual quality. Thus, to ensure the best Quality of Experience (QoE), it is important to evaluate the visual quality to accurately drive the processing operation to find the right compromise between visual quality and data size. In this work, we evaluate the quality of textured 3D meshes. We first establish a large-scale quality assessment dataset, which includes 55 source models and over 343k distorted stimuli. Each model was characterized in terms of geometric, color, and semantic complexity, and corrupted by combinations of 5 types of distortions applied on the geometry and texture of the meshes. We then propose an approach to select a subset of challenging stimuli from our (large-scale) dataset that we annotate in a subjective experiment conducted in crowdsourcing. Leveraging our dataset, a learning-based quality metric for 3D graphics was proposed. Our metric demonstrates state-of-the-art results on our dataset of textured meshes and on a dataset of distorted meshes with vertex colors. Finally, we present an application of our metric to explore the influence of distortion interactions on the perceived quality of 3D graphics.