Mitochondria segmentation in electron microscopy images is essential in neuroscience. However, due to the image degradation during the imaging process, the large variety of mitochondrial structures, as well as the presence of noise, artifacts and other sub-cellular structures, mitochondria segmentation is very challenging. In this paper, we propose a novel and effective contrastive learning framework to learn a better feature representation from hard examples to improve segmentation. Specifically, we adopt a point sampling strategy to pick out representative pixels from hard examples in the training phase. Based on these sampled pixels, we introduce a pixel-wise label-based contrastive loss which consists of a similarity loss term and a consistency loss term. The similarity term can increase the similarity of pixels from the same class and the separability of pixels from different classes in feature space, while the consistency term is able to enhance the sensitivity of the 3D model to changes in image content from frame to frame. We demonstrate the effectiveness of our method on MitoEM dataset as well as FIB-SEM dataset and show better or on par with state-of-the-art results.
翻译:电子显微镜图像的Mitochondria分解在神经科学中至关重要。 然而,由于图像在成像过程中的图像降解,线粒体结构的种类繁多,以及噪音、文物和其他子细胞结构的存在,mitochondria分解非常具有挑战性。在本文件中,我们提出了一个创新和有效的对比学习框架,以从硬实例中学习更好的特征表现来改善分解。具体地说,我们采取了点抽样战略,从培训阶段的硬实例中挑选出具有代表性的像素。根据这些样本像素,我们采用了一种基于像素标签的比素比喻式对比性损失,包括类似性损失术语和一致性损失术语。相似的术语可以增加同一类的像素的相似性,以及地貌空间不同类的像素的可分离性,而一致性术语能够提高3D模型对从框架到框架图像内容变化的敏感度。我们展示了米托EM数据集方法的有效性,以及FIB-SEM-SEM数据集和更好显示状态结果。