Deep implicit functions (DIFs) have emerged as a powerful paradigm for many computer vision tasks such as 3D shape reconstruction, generation, registration, completion, editing, and understanding. However, given a set of 3D shapes with associated covariates there is at present no shape representation method which allows to precisely represent the shapes while capturing the individual dependencies on each covariate. Such a method would be of high utility to researchers to discover knowledge hidden in a population of shapes. We propose a 3D Neural Additive Model for Interpretable Shape Representation (NAISR) which describes individual shapes by deforming a shape atlas in accordance to the effect of disentangled covariates. Our approach captures shape population trends and allows for patient-specific predictions through shape transfer. NAISR is the first approach to combine the benefits of deep implicit shape representations with an atlas deforming according to specified covariates. Although our driving problem is the construction of an airway atlas, NAISR is a general approach for modeling, representing, and investigating shape populations. We evaluate NAISR with respect to shape reconstruction, shape disentanglement, shape evolution, and shape transfer for the pediatric upper airway. Our experiments demonstrate that NAISR achieves competitive shape reconstruction performance while retaining interpretability.
翻译:深层隐含功能(DIFs)已成为许多计算机愿景任务(如3D形状重建、生成、登记、完成、编辑和理解)的强大范例,然而,鉴于三维形状与相关共变体的3D形状组合,目前没有任何形状代表方法能够准确代表形状,同时捕捉每个共变体的个体依赖性。这种方法对于研究人员发现在各种形状群中隐藏的知识非常有用。我们提议了一个3D解释形状代表的3D神经添加模型(NAISR)来描述个人形状,根据分解的共变形效应对形状图进行变形。我们的方法捕捉到人口趋势的形状,并允许通过形状转移来进行针对病人的预测。NAISR是第一个将深度隐含形状代表的惠益与根据具体变形体进行变形的图集相结合的方法。虽然我们的驱动问题是建造一个气道图解,但NAISR是用来模拟、代表和调查成形群群的一般方法。我们评估NAISR的形状的形状的形状的形状变形性,同时评估了我们变形的形状的变形、变形性、变形的造型、变形性、形状的造型。</s>