Neural Radiance Fields (NeRF) have attracted significant attention due to their ability to synthesize novel scene views with great accuracy. However, inherent to their underlying formulation, the sampling of points along a ray with zero width may result in ambiguous representations that lead to further rendering artifacts such as aliasing in the final scene. To address this issue, the recent variant mip-NeRF proposes an Integrated Positional Encoding (IPE) based on a conical view frustum. Although this is expressed with an integral formulation, mip-NeRF instead approximates this integral as the expected value of a multivariate Gaussian distribution. This approximation is reliable for short frustums but degrades with highly elongated regions, which arises when dealing with distant scene objects under a larger depth of field. In this paper, we explore the use of an exact approach for calculating the IPE by using a pyramid-based integral formulation instead of an approximated conical-based one. We denote this formulation as Exact-NeRF and contribute the first approach to offer a precise analytical solution to the IPE within the NeRF domain. Our exploratory work illustrates that such an exact formulation Exact-NeRF matches the accuracy of mip-NeRF and furthermore provides a natural extension to more challenging scenarios without further modification, such as in the case of unbounded scenes. Our contribution aims to both address the hitherto unexplored issues of frustum approximation in earlier NeRF work and additionally provide insight into the potential future consideration of analytical solutions in future NeRF extensions.
翻译:神经辐射场 (NeRF) 由于其准确合成新颖场景视图的能力而受到了广泛关注。然而,由于其基础公式的固有性质,在零宽度的光线上采样点可能导致模糊的表征,从而进一步造成最终场景中的伪影等渲染伪像。为了解决这个问题,最近的变体 mip-NeRF 提出了一种基于锥形视锥的集成定位编码 (IPE)。虽然这是用积分公式表达的,但 mip-NeRF 却将这个积分近似为多元高斯分布的期望值。这种近似在短锥体的情况下是可靠的,但在长锥体的情况下则会导致性能降低,而这种情况在应对具有更大场深度的远场景物体时也会出现。在本文中,我们通过使用基于金字塔的积分公式而非近似的锥形公式来计算 IPE,探讨了一种精确的方法。我们将这种公式记为 Exact-NeRF,并为神经辐射场领域提供了第一种提供精确解决方案的方法。我们的探索性工作表明,Exact-NeRF 公式与 mip-NeRF 公式的精度相当,并且在不需要进一步修改的情况下可以自然地扩展到更具挑战性的场景,例如无界景象的情况。我们的贡献旨在解决 NeRF 早期工作中未被探索的视锥体近似问题,并此外还提供未来 NeRF 扩展中考虑使用解析解的潜在见解。