Log-concave sampling has witnessed remarkable algorithmic advances in recent years, but the corresponding problem of proving lower bounds for this task has remained elusive, with lower bounds previously known only in dimension one. In this work, we establish the following query lower bounds: (1) sampling from strongly log-concave and log-smooth distributions in dimension $d\ge 2$ requires $\Omega(\log \kappa)$ queries, which is sharp in any constant dimension, and (2) sampling from Gaussians in dimension $d$ (hence also from general log-concave and log-smooth distributions in dimension $d$) requires $\widetilde \Omega(\min(\sqrt\kappa \log d, d))$ queries, which is nearly sharp for the class of Gaussians. Here $\kappa$ denotes the condition number of the target distribution. Our proofs rely upon (1) a multiscale construction inspired by work on the Kakeya conjecture in harmonic analysis, and (2) a novel reduction that demonstrates that block Krylov algorithms are optimal for this problem, as well as connections to lower bound techniques based on Wishart matrices developed in the matrix-vector query literature.
翻译:近年来,log-concave抽样已经见证了显著的算法进步,但相应的证明此任务的下界问题一直很难解决,先前仅在维度1中已知下界。在这项工作中,我们建立了以下查询下界:(1)在维数$d\ge 2$中从强log-concave和log-smooth分布抽样需要$\Omega(\log \kappa)$个查询,在任何固定维度中都是尖锐的;(2)在$d$维中从高斯分布中(因此也从$d$维中的一般log-concave和log-smooth分布)抽样需要$\widetilde \Omega(\min(\sqrt\kappa \log d, d))$个查询,对于高斯类的近似尖锐。这里$\kappa$表示目标分布的条件数。我们的证明依赖于(1)一种多尺度构造,灵感来自于谐波分析中关于Kakeya猜想的工作;(2)一种新型约化证明,证明块Krylov算法是此问题的最优算法,以及与基于Wishart矩阵的下界技术的连接,在矩阵向量查询文献中开发。