Deciding on the unimodality of a dataset is an important problem in data analysis and statistical modeling. It allows to obtain knowledge about the structure of the dataset, ie. whether data points have been generated by a probability distribution with a single or more than one peaks. Such knowledge is very useful for several data analysis problems, such as for deciding on the number of clusters and determining unimodal projections. We propose a technique called UU-test (Unimodal Uniform test) to decide on the unimodality of a one-dimensional dataset. The method operates on the empirical cumulative density function (ecdf) of the dataset. It attempts to build a piecewise linear approximation of the ecdf that is unimodal and models the data sufficiently in the sense that the data corresponding to each linear segment follows the uniform distribution. A unique feature of this approach is that in the case of unimodality, it also provides a statistical model of the data in the form of a Uniform Mixture Model. We present experimental results in order to assess the ability of the method to decide on unimodality and perform comparisons with the well-known dip-test approach. In addition, in the case of unimodal datasets we evaluate the Uniform Mixture Models provided by the proposed method using the test set log-likelihood and the two-sample Kolmogorov-Smirnov (KS) test.
翻译:在数据分析和统计模型中,一个数据集的单一特性是一个重要的问题。它能够获取关于数据集结构的知识,例如,数据点是否由一个或一个以上峰值的概率分布生成。这种知识对若干数据分析问题非常有用,例如决定组数和确定单式预测。我们建议一种叫UU-测试(Umodal统一统一测试)的技术,以决定一维数据集的单一特性。该方法以数据集的经验累积密度函数(ecdf)为操作。它试图用单式和模型充分模拟数据,使每个线性部分的相应数据在统一分布之后。这个方法的一个独特特征是,在单式情况下,它也提供了一种以统一混合模型形式显示的数据统计模型。我们提出实验结果,以便评估用以确定不适应性的方法以及用我们所熟悉的测试方法进行不适应性测试方法的比较的能力。