3D Gaussian Splatting (3DGS) has recently attracted wide attentions in various areas such as 3D navigation, Virtual Reality (VR) and 3D simulation, due to its photorealistic and efficient rendering performance. High-quality reconstrution of 3DGS relies on sufficient splats and a reasonable distribution of these splats to fit real geometric surface and texture details, which turns out to be a challenging problem. We present GeoTexDensifier, a novel geometry-texture-aware densification strategy to reconstruct high-quality Gaussian splats which better comply with the geometric structure and texture richness of the scene. Specifically, our GeoTexDensifier framework carries out an auxiliary texture-aware densification method to produce a denser distribution of splats in fully textured areas, while keeping sparsity in low-texture regions to maintain the quality of Gaussian point cloud. Meanwhile, a geometry-aware splitting strategy takes depth and normal priors to guide the splitting sampling and filter out the noisy splats whose initial positions are far from the actual geometric surfaces they aim to fit, under a Validation of Depth Ratio Change checking. With the help of relative monocular depth prior, such geometry-aware validation can effectively reduce the influence of scattered Gaussians to the final rendering quality, especially in regions with weak textures or without sufficient training views. The texture-aware densification and geometry-aware splitting strategies are fully combined to obtain a set of high-quality Gaussian splats. We experiment our GeoTexDensifier framework on various datasets and compare our Novel View Synthesis results to other state-of-the-art 3DGS approaches, with detailed quantitative and qualitative evaluations to demonstrate the effectiveness of our method in producing more photorealistic 3DGS models.
翻译:3D高斯泼溅(3DGS)凭借其逼真的渲染效果与高效的渲染性能,近期在三维导航、虚拟现实(VR)及三维仿真等领域受到广泛关注。高质量的3DGS重建依赖于足够的泼溅点及其合理分布,以拟合真实的几何表面与纹理细节,这已成为一个具有挑战性的问题。本文提出GeoTexDensifier,一种新颖的几何-纹理感知致密化策略,用于重建更贴合场景几何结构与纹理丰富度的高质量高斯泼溅点。具体而言,我们的GeoTexDensifier框架采用一种辅助的纹理感知致密化方法,在纹理丰富区域生成更密集的泼溅点分布,同时在低纹理区域保持稀疏性以维持高斯点云的质量。同时,一种几何感知的分裂策略利用深度与法向先验指导分裂采样,并通过“深度比率变化验证”检查,滤除初始位置远离其拟合理想几何表面的噪声泼溅点。借助相对单目深度先验,此类几何感知验证能有效减少散乱高斯点对最终渲染质量的影响,尤其在纹理较弱或训练视角不足的区域。纹理感知致密化与几何感知分裂策略被充分结合,以获取一组高质量的高斯泼溅点。我们在多个数据集上对GeoTexDensifier框架进行实验,并将新视角合成结果与其他前沿3DGS方法进行比较,通过详细的定量与定性评估,证明了本方法在生成更逼真3DGS模型方面的有效性。