Image-to-image translation (I2I) methods allow the generation of artificial images that share the content of the original image but have a different style. With the advances in Generative Adversarial Networks (GANs)-based methods, I2I methods enabled the generation of artificial images that are indistinguishable from natural images. Recently, I2I methods were also employed in histopathology for generating artificial images of in silico stained tissues from a different type of staining. We refer to this process as stain transfer. The number of I2I variants is constantly increasing, which makes a well justified choice of the most suitable I2I methods for stain transfer challenging. In our work, we compare twelve stain transfer approaches, three of which are based on traditional and nine on GAN-based image processing methods. The analysis relies on complementary quantitative measures for the quality of image translation, the assessment of the suitability for deep learning-based tissue grading, and the visual evaluation by pathologists. Our study highlights the strengths and weaknesses of the stain transfer approaches, thereby allowing a rational choice of the underlying I2I algorithms. Code, data, and trained models for stain transfer between H&E and Masson's Trichrome staining will be made available online.
翻译:图像到图像转换(I2I)方法允许生成人工图像,这些图像与原始图像共享内容,但具有不同的样式。随着基于生成式对抗网络(GAN)的方法的发展,I2I方法使得能够生成与自然图像无法区分的人工图像。最近,I2I方法也被应用于病理学,用于从不同类型的染色中生成具有与原始图像不同染色的人工图像。我们将这个过程称为染色转移。 I2I变体的数量不断增加,这使得选择最适合于染色转移的合适I2I方法具有挑战性。在我们的工作中,我们比较了12种染色转移方法,其中3种基于传统方法,9种基于GAN的图像处理方法。分析依赖于用于评估图像转换质量、评估适合于基于深度学习的组织分级的方法以及病理医生视觉评估的互补定量指标。我们的研究强调了染色转移方法的优点和缺点,从而使得可以理性地选择I2I算法。在H&E和Masson's Trichrome染色之间的染色转移的代码、数据和训练模型将在线提供。