Pathologists need to combine information from differently stained pathology slices for accurate diagnosis. Deformable image registration is a necessary technique for fusing multi-modal pathology slices. This paper proposes a hybrid deep feature-based deformable image registration framework for stained pathology samples. We first extract dense feature points via the detector-based and detector-free deep learning feature networks and perform points matching. Then, to further reduce false matches, an outlier detection method combining the isolation forest statistical model and the local affine correction model is proposed. Finally, the interpolation method generates the deformable vector field for pathology image registration based on the above matching points. We evaluate our method on the dataset of the Non-rigid Histology Image Registration (ANHIR) challenge, which is co-organized with the IEEE ISBI 2019 conference. Our technique outperforms the traditional approaches by 17% with the Average-Average registration target error (rTRE) reaching 0.0034. The proposed method achieved state-of-the-art performance and ranked 1st in evaluating the test dataset. The proposed hybrid deep feature-based registration method can potentially become a reliable method for pathology image registration.
翻译:病理学家需要将不同染色的病理切片信息进行组合以进行准确的诊断。可变形图像配准是多模态病理切片融合的必要技术。本文提出了一种基于混合深度特征的可变形图像配准框架,用于染色病理样本。我们首先通过基于检测器和无检测器的深度学习特征网络提取密集特征点并进行点匹配。然后,为了进一步减少错误匹配,我们提出了一种异常值检测方法,结合孤立森林统计模型和局部仿射校正模型。最后,插值方法根据上述匹配点生成病理图像的可变形向量场。我们在与IEEE ISBI 2019会议合作的非刚性组织学图像配准(ANHIR)挑战数据集上评估了这种方法。我们的技术在平均平均配准目标误差(ATRE)达到0.0034的情况下,比传统方法提高了17%。该方法在测试数据集的评估中取得了最先进的表现,并排名第一。基于混合深度特征的配准方法有望成为病理学图像配准的可靠方法。