With the remarkable success of representation learning for prediction problems, we have witnessed a rapid expansion of the use of machine learning and deep learning for the analysis of digital pathology and biopsy image patches. However, traditional learning over patch-wise features using convolutional neural networks limits the model when attempting to capture global contextual information. The phenotypical and topological distribution of constituent histological entities play a critical role in tissue diagnosis. As such, graph data representations and deep learning have attracted significant attention for encoding tissue representations, and capturing intra- and inter- entity level interactions. In this review, we provide a conceptual grounding of graph-based deep learning and discuss its current success for tumor localization and classification, tumor invasion and staging, image retrieval, and survival prediction. We provide an overview of these methods in a systematic manner organized by the graph representation of the input image including whole slide images and tissue microarrays. We also outline the limitations of existing techniques, and suggest potential future advances in this domain.
翻译:由于预测问题的代表性学习取得了显著的成功,我们目睹了利用机器学习和深层次学习来分析数字病理学和生物心理图像的迅速扩展,然而,利用进化神经网络对补丁特征的传统学习限制了模型在试图获取全球背景信息时的局限性。组成组织组织实体的芬特异和地形分布在组织诊断中发挥着关键作用。因此,图表数据表达和深层次学习吸引了对编码组织表述的极大关注,并捕捉了实体内部和实体之间的相互作用。在这次审查中,我们提供了基于图表的深层次学习的概念基础,并讨论了目前肿瘤本地化和分类、肿瘤入侵和发端、图像检索和生存预测方面的成功。我们系统地概述了这些方法,这些方法是由包括整个幻灯片图像和组织缩影在内的投入图像的图示形式所组织的。我们还概述了现有技术的局限性,并提出了该领域未来可能取得的进展。