The survival analysis on histological whole-slide images (WSIs) is one of the most important means to estimate patient prognosis. Although many weakly-supervised deep learning models have been developed for gigapixel WSIs, their potential is generally restricted by classical survival analysis rules and fully-supervision requirements. As a result, these models provide patients only with a completely-certain point estimation of time-to-event, and they could only learn from the well-annotated WSI data currently at a small scale. To tackle these problems, we propose a novel adversarial multiple instance learning (AdvMIL) framework. This framework is based on adversarial time-to-event modeling, and it integrates the multiple instance learning (MIL) that is much necessary for WSI representation learning. It is a plug-and-play one, so that most existing WSI-based models with embedding-level MIL networks can be easily upgraded by applying this framework, gaining the improved ability of survival distribution estimation and semi-supervised learning. Our extensive experiments show that AdvMIL could not only bring performance improvement to mainstream WSI models at a relatively low computational cost, but also enable these models to learn from unlabeled data with semi-supervised learning. Our AdvMIL framework could promote the research of time-to-event modeling in computational pathology with its novel paradigm of adversarial MIL.
翻译:肿瘤全滑动图像的求生分析是估计病人预测率的最重要手段之一。虽然为Gangapixel WSI开发了许多受微弱监督的深层次学习模型,但这些模型的潜力一般受到古典生存分析规则和完全监督要求的限制。因此,这些模型只能为病人提供完全确定点的时间与活动之间的时间与活动估计,他们只能从目前备有良好注释的WSI数据中小幅学习。为了解决这些问题,我们提议了一个新的对抗性多实例学习(AdvMIL)框架。这个框架以对抗性时间与活动建模为基础,并结合了多实例学习(MIL)的潜力,而这是WSI代表学习所非常必要的。这是一个插接和游戏,因此,大多数以嵌入级别MIL网络为基础的基于WSI的现有模型可以很容易地通过应用这个框架来升级,获得更好的生存分布估计能力和半监督性范式学习。我们的广泛实验显示,AdvMIL不仅能将业绩改进的模型与低成本模型一起,而且还能使我们的模型升级的模型升级为主流WSI。