As segmentation labels are scarce, extensive researches have been conducted to train segmentation networks with domain adaptation, semi-supervised or self-supervised learning techniques to utilize abundant unlabeled dataset. However, these approaches appear different from each other, so it is not clear how these approaches can be combined for better performance. Inspired by recent multi-domain image translation approaches, here we propose a novel segmentation framework using adaptive instance normalization (AdaIN), so that a single generator is trained to perform both domain adaptation and semi-supervised segmentation tasks via knowledge distillation by simply changing task-specific AdaIN codes. Specifically, our framework is designed to deal with difficult situations in chest X-ray radiograph (CXR) segmentation, where labels are only available for normal data, but trained model should be applied to both normal and abnormal data. The proposed network demonstrates great generalizability under domain shift and achieves the state-of-the-art performance for abnormal CXR segmentation.
翻译:由于分层标签很少,因此进行了广泛的研究,以培训分层网络,包括领域适应、半监督或自监督的学习技术,以利用大量未贴标签的数据集。然而,这些方法似乎彼此不同,因此不清楚如何将这些方法结合起来以取得更好的性能。受最近多领域图像翻译方法的启发,我们在此提议采用适应性实例正常化的新颖分层框架(AdaIN),以便单一的发电机通过简单的改变特定任务的AdaIN代码,通过知识蒸馏来进行域适应和半监督分层任务的培训。具体地说,我们的框架旨在处理胸部X射线分层的难题,因为只有正常数据才有标签,但经过培训的模式应适用于正常和异常数据。拟议的网络显示在域转移下非常普遍,并实现了异常的CXR分解的状态。