Computer vision-based methods have valuable use cases in precision medicine, and recognizing facial phenotypes of genetic disorders is one of them. Many genetic disorders are known to affect faces' visual appearance and geometry. Automated classification and similarity retrieval aid physicians in decision-making to diagnose possible genetic conditions as early as possible. Previous work has addressed the problem as a classification problem and used deep learning methods. The challenging issue in practice is the sparse label distribution and huge class imbalances across categories. Furthermore, most disorders have few labeled samples in training sets, making representation learning and generalization essential to acquiring a reliable feature descriptor. In this study, we used a facial recognition model trained on a large corpus of healthy individuals as a pre-task and transferred it to facial phenotype recognition. Furthermore, we created simple baselines of few-shot meta-learning methods to improve our base feature descriptor. Our quantitative results on GestaltMatcher Database show that our CNN baseline surpasses previous works, including GestaltMatcher, and few-shot meta-learning strategies improve retrieval performance in frequent and rare classes.
翻译:基于计算机的视觉方法在精密医学中具有宝贵的应用案例,并且承认面部基因紊乱的细胞型是其中之一。许多遗传障碍已知会影响面部的视觉外观和几何特征。自动化分类和相似性检索帮助医生决策尽早诊断可能的遗传条件。以前的工作已经将这一问题作为一个分类问题加以解决,并使用了深层次的学习方法。实际中具有挑战性的问题在于标签分布稀少和不同类别之间的巨大阶级不平衡。此外,大多数障碍在培训成套材料中只有很少的标签样本,因此代表学习和概括化对于获得可靠的特征描述器至关重要。在这项研究中,我们用一个在大批健康人身上受过训练的面部识别模型作为预任务,将其转移到面部型识别上。此外,我们为改进我们的基本特征描述器创建了少量的元学习方法的简单基线。我们在GestaltMatcher数据库上的定量结果显示,我们的CNN基线超过了以前的作品,包括GestaltMatcher, 和几发式的元学习战略改进了经常和稀有的检索性。