In this paper, we present Neural Adaptive Tomography (NeAT), the first adaptive, hierarchical neural rendering pipeline for multi-view inverse rendering. Through a combination of neural features with an adaptive explicit representation, we achieve reconstruction times far superior to existing neural inverse rendering methods. The adaptive explicit representation improves efficiency by facilitating empty space culling and concentrating samples in complex regions, while the neural features act as a neural regularizer for the 3D reconstruction. The NeAT framework is designed specifically for the tomographic setting, which consists only of semi-transparent volumetric scenes instead of opaque objects. In this setting, NeAT outperforms the quality of existing optimization-based tomography solvers while being substantially faster.
翻译:在本文中,我们介绍神经适应性成像(NEAT),这是第一个适应性、等级性神经转换管道,供多视图反向转换使用。通过将神经特征与适应性直观表达相结合,我们实现了比现有神经反向转换方法更优越的重建时代。适应性直观表达提高了效率,便利在复杂区域填充和集中空空间样本,而神经特征则是3D重建的神经调节器。NEAT框架是专门为透视设置设计的,仅包括半透明的体积场景,而不是不透明的物体。在这个设置中,NET在大大加快的同时,超越了现有基于优化的摄影解析器的质量。