基于内镜视频图像的胃内壁动态表面建模研究

项目名称： 基于内镜视频图像的胃内壁动态表面建模研究

项目编号： No.31470955

项目类型： 面上项目

立项/批准年度： 2015

项目学科： 生物科学

项目作者： 刘济全

作者单位： 浙江大学

项目金额： 80万元

中文摘要： 本项目主要研究完全基于内镜视频图像重建人体软性腔体器官的三维动态表面的技术方法，并以胃镜为切入点，尝试构建基于胃镜光学图像的胃内壁动态表面模型。与常规通过断层扫描成像重建瞬时静态模型的方法不同，本项目拟采用的方法仅依赖内镜检查过程中的光学图像实现动态模型的构建。本项目拟采用的技术方案具体如下：1）研究建立基于内镜检查的空间定标体系，研制具有实时定位功能的胃镜镜头；2）研究弱特征下胃镜视频图像的密集特征点提取和序列图像间的配准方法；3）利用运动恢复结构方法，研究实现基于单目可追踪镜头下的胃镜视频图像重建胃内壁的几何结构；4）研究实现胃镜检查下非完备表面的融合技术以及视频纹理映射技术，以形成具有真实视觉效果的、完整的胃内壁动态表面；5）研制一种具有增强现实效果的胃镜检查介入引导系统，对本项目的建模方法进行验证。本项目的研究成果可以在结肠等其它人体软性器官的动态建模和介入引导手术得到应用。

中文关键词： 动态表面建模；图像引导介入技术；运动恢复结构；特征点匹配；胃镜活检定标

英文摘要： A novel dynamic 3D surface reconstruction method for human soft cavity organs will be researched in this project, which is only based on video images captured by endoscopy. Compared with the conventional reconstruction method of static 3D surface model, which is usually generated from medical tomographic images, the method adopted by this project generates dynamic 3D surface model with the endoscopic video images only, which makes the method has the potential of realizing real-time dynamic 3D surface model generating during endoscopy procedure. This project takes gastroscopy as a study object, and attempts to reconstruct the dynamic 3D surface model of stomach wall based on gastroscopic optical images. The research scheme can be described as following: 1) research on establishing space coordinate system for gastroscopy procedure based on medical space sensor, and develop novel traceable gastroscopy lens which can detect the real-time position information with 6 degrees of freedom. The problem of camera calibration and correction of distortion image resulting from the fisheye lens of gastroscope will be resolved in this project; 2. research on dense feature point detection method in weakly featured gastroscopic optical image, and finding feature points correspondence among gastroscopic video images according to the traceable gastroscopic lens; 3) by introducing the computer vision technique, Structure From Motion (SFM), a method of generating partial 3D surface patch will be provided, which is based on overlapped gastroscopic images captured by the single traceable gastroscopic lens from different viewpoint; 4) research on non-complete gastric surface fusion method to stitch those surface patches into a complete 3D surface, and using video texture mapping technology to realize the dynamic 3D surface model of stomach wall with the same visual effect of gastroscopy; 5) finally, an image guided intervention system with enhanced reality for gastroscopy will be developed to verify the 3D modeling method presented in this project. The research results of this project can also be widely applied to dynamic modeling and image guided intervention for other soft cavity organs, such as bronchoscopy, colonoscopy, and so on.

英文关键词： Dynamic Surface Modeling;Image-guided Intervention;Structure from Motion;Feature Points Correnpondence;Gastroscopy Biopsy Marking