论文标题
Riemannian统计符合随机矩阵理论:从高维协方差矩阵中学习
Riemannian statistics meets random matrix theory: towards learning from high-dimensional covariance matrices
论文作者
论文摘要
最初将里曼尼亚高斯分布作为学习模型的基本构建块,旨在捕获正定矩阵的统计群体的内在结构(这里称为协方差矩阵)。尽管此类模型的潜在应用引起了极大的关注,但主要的障碍仍然阻碍了这些应用的方式:似乎没有实际方法来计算与Riemannian Gaussian分布相关的归一化因子,这是在高维协方差矩阵上的。本文表明,这种缺失的方法来自与随机矩阵理论的意外新联系。它的主要贡献是证明真实,复杂或季节协方差矩阵的riemannian高斯高斯分布相当于正交,统一或合成的对数正态矩阵集合。就相当简单的分析表达而言,这种等效性产生了归一化因素的高效近似。由于这种近似值而引起的误差降低,例如维数的反平方。进行了数值实验,该实验证明了这种新的近似如何解锁对高维协方差矩阵现实世界数据集的困难。然后,该论文转向了Riemannian Gaussian的块状协方差矩阵分布。这些等同于另一种随机矩阵合奏,此处称为“ Acosh-Normal”合奏。正交和统一的“ Acosh-Normal”集团分别对应于带有toeplitz块的块状toeplitz的情况,分别对应于块状toeplitz(带有一般块)协方差矩阵。
Riemannian Gaussian distributions were initially introduced as basic building blocks for learning models which aim to capture the intrinsic structure of statistical populations of positive-definite matrices (here called covariance matrices). While the potential applications of such models have attracted significant attention, a major obstacle still stands in the way of these applications: there seems to exist no practical method of computing the normalising factors associated with Riemannian Gaussian distributions on spaces of high-dimensional covariance matrices. The present paper shows that this missing method comes from an unexpected new connection with random matrix theory. Its main contribution is to prove that Riemannian Gaussian distributions of real, complex, or quaternion covariance matrices are equivalent to orthogonal, unitary, or symplectic log-normal matrix ensembles. This equivalence yields a highly efficient approximation of the normalising factors, in terms of a rather simple analytic expression. The error due to this approximation decreases like the inverse square of dimension. Numerical experiments are conducted which demonstrate how this new approximation can unlock the difficulties which have impeded applications to real-world datasets of high-dimensional covariance matrices. The paper then turns to Riemannian Gaussian distributions of block-Toeplitz covariance matrices. These are equivalent to yet another kind of random matrix ensembles, here called "acosh-normal" ensembles. Orthogonal and unitary "acosh-normal" ensembles correspond to the cases of block-Toeplitz with Toeplitz blocks, and block-Toeplitz (with general blocks) covariance matrices, respectively.