This paper presents a new technique for the virtual reality (VR) visu-alization of complex volume images obtained from computer tomography (CT) and Magnetic Resonance Imaging (MRI) by combining three-dimensional (3D) mesh processing and software coding within the gaming engine. The method operates on real representations of human organs avoiding any structural ap-proximations of the real physiological shape. In order to obtain realistic repre-sentation of the mesh model, geometrical and topological corrections are per-formed on the mesh surface with preserving real shape and geometric structure. Using mathematical intervention on the 3D model and mesh triangulation the second part of our algorithm ensures an automatic construction of new two-dimensional (2D) shapes that represent vector slices along any user chosen di-rection. The final result of our algorithm is developed software application that allows to user complete visual experience and perceptual exploration of real human organs through spatial manipulation of their 3D models. Thus our pro-posed method achieves a threefold effect: i) high definition VR representation of real models of human organs, ii) the real time generated slices of such a model along any directions, and iii) almost unlimited amount of training data for machine learning that is very useful in process of diagnosis. In addition, our developed application also offers significant benefits to educational process by ensuring interactive features and quality perceptual user experience.
翻译:本文提出了一种新的技术,通过将三维网格处理和游戏引擎中的软件编码相结合,实现从计算机断层扫描(CT)和磁共振成像(MRI)获得的复杂体积图像的虚拟现实(VR)可视化。该方法操作真实的人体器官表示,避免任何结构上的逼近。为了获得网格模型的逼真表示,对网格表面进行几何和拓扑修正,保持真实形状和几何结构。使用数学干预对三维模型和网格三角化进行修正,确保沿任何用户选择的方向生成新的代表矢量切片的二维形状的自动构建。我们算法的最终结果是开发的软件应用程序,允许用户通过对其三维模型的空间操作实现完整的视觉体验和感知探索真实人体器官。因此,我们提出的方法实现了三个效果:i)真实模型的高清晰度VR表示,ii)沿任何方向实时生成的该模型的切片,和 iii)对诊断过程非常有用的几乎无限量的机器学习培训数据。此外,我们开发的应用还具有重要的教育价值,通过确保交互式功能和良好的感知用户体验提供帮助。