Optimal approximate matrix product in terms of stable rank

作者: Michael B. Cohen , Jelani Nelson , David P. Woodruff

DOI:

关键词:

摘要: We prove, using the subspace embedding guarantee in a black box way, that one can achieve spectral norm for approximate matrix multiplication with dimensionality-reducing map having $m = O(\tilde{r}/\varepsilon^2)$ rows. Here $\tilde{r}$ is maximum stable rank, i.e. squared ratio of Frobenius and operator norms, two matrices being multiplied. This quantitative improvement over previous work [MZ11, KVZ14], also optimal any oblivious map. Furthermore, due to reliance on property our proofs, theorem be applied much more general class sketching than what was known before, addition achieving better bounds. For example, apply efficient embeddings such as Subsampled Randomized Hadamard Transform or sparse embeddings, even constructions may developed future. Our main theorem, via connections error shown prior work, implies improvements least squares regression low rank approximation. Our result has already been improve dimensionality reduction guarantees $k$-means clustering [CEMMP14], new results nonparametric [YPW15]. We separately point out proof "BSS" deterministic row-sampling [BSS12] modified show $A, B$ at most $\tilde{r}$, $A^T by deterministically sampling $O(\tilde{r}/\varepsilon^2)$ rows found polynomial time. The original instead rank. observation leads stronger version [KMST10].

参考文章(29)
Jean Bourgain, An Improved Estimate in the Restricted Isometry Problem Springer International Publishing. pp. 65- 70 ,(2014) , 10.1007/978-3-319-09477-9_5
Moses Charikar, Kevin Chen, Martin Farach-Colton, Finding Frequent Items in Data Streams international colloquium on automata languages and programming. ,vol. 312, pp. 693- 703 ,(2002) , 10.1016/S0304-3975(03)00400-6
Joel A. Tropp, An Introduction to Matrix Concentration Inequalities arXiv: Probability. ,(2015)
Petros Drineas, Ravi Kannan, Michael W. Mahoney, Fast Monte Carlo Algorithms for Matrices I: Approximating Matrix Multiplication SIAM Journal on Computing. ,vol. 36, pp. 132- 157 ,(2006) , 10.1137/S0097539704442684
Tamas Sarlos, Improved Approximation Algorithms for Large Matrices via Random Projections foundations of computer science. pp. 143- 152 ,(2006) , 10.1109/FOCS.2006.37
Mikkel Thorup, Yin Zhang, Tabulation-Based 5-Independent Hashing with Applications to Linear Probing and Second Moment Estimation SIAM Journal on Computing. ,vol. 41, pp. 293- 331 ,(2012) , 10.1137/100800774
Kenneth L. Clarkson, David P. Woodruff, Numerical linear algebra in the streaming model Proceedings of the 41st annual ACM symposium on Symposium on theory of computing - STOC '09. pp. 205- 214 ,(2009) , 10.1145/1536414.1536445
Anirban Dasgupta, Ravi Kumar, Tamás Sarlos, A sparse Johnson Proceedings of the 42nd ACM symposium on Theory of computing - STOC '10. pp. 341- 350 ,(2010) , 10.1145/1806689.1806737
Nir Ailon, Bernard Chazelle, The Fast Johnson-Lindenstrauss Transform and Approximate Nearest Neighbors SIAM Journal on Computing. ,vol. 39, pp. 302- 322 ,(2009) , 10.1137/060673096
Mu Li, Gary L. Miller, Richard Peng, Iterative Row Sampling 2013 IEEE 54th Annual Symposium on Foundations of Computer Science. ,vol. 2013, pp. 127- 136 ,(2013) , 10.1109/FOCS.2013.22