Neural implicit functions are highly effective for representing many kinds of data, including images and 3D shapes. However, the implicit functions learned by neural networks usually include over-smoothed patches or noisy artifacts into the results if the data has many scales of details or a wide range of frequencies. Adapting the result containing both noise and over-smoothed regions usually suffers from either over smoothing or noisy issues. To overcome this challenge, we propose a new framework, coined FINN, that integrates a filtering module into the neural network to perform data generation while filtering artifacts. The filtering module has a smoothing operator that acts on the intermediate results of the network and a recovering operator that brings distinct details from the input back to the regions overly smoothed. The proposed method significantly alleviates over smoothing or noisy issues. We demonstrate the advantage of the FINN on the image regression task, considering both real-world and synthetic images, and showcases significant improvement on both quantitative and qualitative results compared to state-of-the-art methods. Moreover, FINN yields better performance in both convergence speed and network stability. Source code is available at https://github.com/yixin26/FINN.
翻译:神经隐含功能对于代表多种数据(包括图像和3D形状)非常有效。然而,神经网络所学的隐含功能通常包括过度移动的补丁或噪声制品,如果数据包含许多细节或频率范围很广,则这些隐含功能通常包括过度移动的补丁或噪音制品。调整含有噪音和过度拥挤区域的结果通常存在过于平滑或吵闹的问题。为了克服这一挑战,我们提议一个新的框架,即硬化的FINN,将过滤模块纳入神经网络,以便在过滤文物的同时进行数据生成。过滤模块有一个顺畅的操作器,对网络的中间结果采取行动,而恢复操作器则从输入到过于平滑的地区提供不同的细节。拟议方法大大缓解了平滑或吵闹的问题。我们展示了FINN在图像回归任务方面的优势,既考虑到真实世界图像,又考虑到合成图像,并展示了与艺术状态方法相比在定量和定性结果方面的显著改进。此外,FINN的过滤模块在趋同速度和网络稳定性两方面都有更好的性。源码可在 http://Nsix/FINDOR/FIN。