Recent developments in self-supervised learning give us the possibility to further reduce human intervention in multi-step pipelines where the focus evolves around particular objects of interest. In the present paper, the focus lays in the nuclei in histopathology images. In particular we aim at extracting cellular information in an unsupervised manner for a downstream task. As nuclei present themselves in a variety of sizes, we propose a new Scale-dependant convolutional layer to bypass scaling issues when resizing nuclei. On three nuclei datasets, we benchmark the following methods: handcrafted, pre-trained ResNet, supervised ResNet and self-supervised features. We show that the proposed convolution layer boosts performance and that this layer combined with Barlows-Twins allows for better nuclei encoding compared to the supervised paradigm in the low sample setting and outperforms all other proposed unsupervised methods. In addition, we extend the existing TNBC dataset to incorporate nuclei class annotation in order to enrich and publicly release a small sample setting dataset for nuclei segmentation and classification.
翻译:自我监督学习的最新发展使我们有可能进一步减少多步管道中的人类干预,因为其重点围绕特定感兴趣的对象。在本文件中,重点在组织病理学图像的核中。特别是我们的目标是为下游任务以不受监督的方式提取细胞信息。随着核心以不同大小呈现自己,我们提议一个新的规模小的依附性卷变层,以在重新调整核心时绕过缩放问题。关于三个核心数据集,我们设定了以下方法的基准:手工制作的、预先训练的ResNet、监管的ResNet和自我监督的特征。我们表明,拟议的演动层能提高性能,这一层与Barlows-Twins相结合,可以与低样本中受监督的范式相比,更好地进行核编码,并超越所有其他拟议的不受监督的方法。此外,我们扩大了现有的TNBC数据集,以纳入核级分类说明,以便浓缩和公开发布用于小段的样品,用于分类。