We consider random matrices whose entries are obtained by applying a (nonlinear) kernel function to the pairwise inner products between $n$ independent data vectors drawn uniformly from the unit sphere in $\mathbb{R}^d$. Our study of this model is motivated by problems in machine learning, statistics, and signal processing, where such inner-product kernel random matrices and their spectral properties play important roles. Under mild conditions on the kernel function, we establish the weak-limit of the empirical spectral distribution of these matrices when $d, n \to \infty$ such that $n / d^\ell \to \kappa \in (0, \infty)$, for some fixed $\ell \in \mathbb{N}$ and $\kappa \in \mathbb{R}$. This generalizes an earlier result of Cheng and Singer (2013), who studied the same model in the linear scaling regime (with $\ell = 1$ and $n/d \to \kappa$). The main insight of our work is a general equivalence principle: the spectrum of the random kernel matrix is asymptotically equivalent to that of a simpler matrix model, constructed as the linear combination of a (shifted) Wishart matrix and an independent matrix drawn from the Gaussian orthogonal ensemble. The aspect ratio of the Wishart matrix and the coefficients of the linear combination are determined by $\ell$ and by the expansion of the kernel function in the orthogonal Hermite polynomial basis. Consequently, the limiting spectrum of the random kernel matrix can be characterized as the free additive convolution between a Marchenko-Pastur law and a semicircle law.
翻译:我们考虑随机矩阵,其条目是通过在对称内产物中应用一个(非线性)内核函数获得的,这些内产物在美元/马什布{R ⁇ d$美元(美元、美元/美元/美元/美元/美元)中独立数据矢量统一从单位球体中提取。我们对这一模型的研究的动机是机器学习、统计和信号处理方面的问题,在这类内产产品内核随机矩阵及其光谱属性起着重要作用。在内核函数的轻微条件下,我们确定这些矩阵的经验光谱分布的薄弱范围,当美元/美元/美元/美元/美元/美元/美元/美元之间,这样,从单位球体范围(美元/美元/美元/美元/美元/美元/美元/美元/美元/美元/美元/美元/美元/美元/美元/美元)中,对于某些固定的机体学习、统计和信号处理的机体内内内内内内核内核内基质的内基质和内基质的内基内基质,可以确定一个内部基质的内基质和内基质的内基内基内基体的内基体的内基质的直基体。由内基质的内基质-内基质的内基质和内基质的内基质的内基质的内基质的内基质的内基质的内基质的内基质的内基底的内基质的内基质的内基质,可以确定为直基质-直基质-内基质-直基体的内基体的内基体的内基体的内基体的内基体的内基体的内基体的内基体的内基体根基体的直基体的直基体的直基体根基体和直基体根基体根基体根基底基的直基体的底的底的底的直基的内和直基的直基体的底基体的底的底的底的底的底的底的底的底的底的底的底基的底的底的内基的底的底的底基体的基体的底的内基的内基体的底基体的底基体的内基体和直基的底基体的内基体的