The heavy reliance on data is one of the major reasons that currently limit the development of deep learning. Data quality directly dominates the effect of deep learning models, and the long-tailed distribution is one of the factors affecting data quality. The long-tailed phenomenon is prevalent due to the prevalence of power law in nature. In this case, the performance of deep learning models is often dominated by the head classes while the learning of the tail classes is severely underdeveloped. In order to learn adequately for all classes, many researchers have studied and preliminarily addressed the long-tailed problem. In this survey, we focus on the problems caused by long-tailed data distribution, sort out the representative long-tailed visual recognition datasets and summarize some mainstream long-tailed studies. Specifically, we summarize these studies into ten categories from the perspective of representation learning, and outline the highlights and limitations of each category. Besides, we have studied four quantitative metrics for evaluating the imbalance, and suggest using the Gini coefficient to evaluate the long-tailedness of a dataset. Based on the Gini coefficient, we quantitatively study 20 widely-used and large-scale visual datasets proposed in the last decade, and find that the long-tailed phenomenon is widespread and has not been fully studied. Finally, we provide several future directions for the development of long-tailed learning to provide more ideas for readers.
翻译:大量依赖数据是目前限制深层学习发展的主要原因之一。数据质量是影响数据质量的因素之一。数据质量直接主导深层学习模式的影响,长尾分发是影响数据质量的因素之一。长尾现象由于权力法的普遍存在而普遍存在。在这种情况下,深层学习模式的绩效往往由主班主导,而尾尾班的学习则严重不足。为了对所有班进行充分学习,许多研究人员已经研究并初步解决了长尾问题。在本次调查中,我们集中研究长尾数据分配造成的问题,整理有代表性的长尾目识别数据集并总结一些主流的长尾研究。具体地说,我们从代表性学习的角度将这些研究归纳成十个类别,并概述每个类别的重点和局限性。此外,我们研究了用于评估不平衡状况的四种定量指标,并建议使用基尼系数来评估长尾的数据集。根据吉尼系数,我们量化研究了20个有代表性的长尾目识别数据集,并总结了某些有代表性的长尾研究,我们最后为最近十年提出的许多长期学习趋势提供了若干长期的长尾研究方向。我们为最近十年提出的长期研究的远尾研拟数据。