Iterative Row Sampling

作者: Mu Li , Gary L. Miller , Richard Peng

DOI: 10.1109/FOCS.2013.22

关键词:

摘要: There has been significant interest and progress recently in algorithms that solve regression problems involving tall thin matrices input sparsity time. Given a n * d matrix where g d, these find an approximation with fewer rows, allowing one to poly(d) sized problem instead. In practice, the best performances are often obtained by invoking routines iterative fashion. We show methods can be adapted give theoretical guarantees comparable better than current state of art. Our approaches based on computing importances known as leverage scores, manner. alternating between short estimate finding more accurate approximate scores leads series geometrically smaller instances. This gives algorithm whose runtime is plus overhead cost solving approximation. results build upon close connection randomized algorithms, methods, graph sparsification.

参考文章(43)
Gilbert Strang, Introduction to Linear Algebra ,(1993)
Malik Magdon-Ismail, Row Sampling for Matrix Algorithms via a Non-Commutative Bernstein Bound arXiv: Data Structures and Algorithms. ,(2010)
Petros Drineas, Michael W. Mahoney, Effective Resistances, Statistical Leverage, and Applications to Linear Equation Solving arXiv: Numerical Analysis. ,(2010)
Daniel A. Spielman, Jaeoh Woo, A Note on Preconditioning by Low-Stretch Spanning Trees arXiv: Numerical Analysis. ,(2009)
Boulos Harb, Michael W. Mahoney, Petros Drineas, Anirban Dasgupta, Ravi Kumar, Sampling algorithms and coresets for ep regression symposium on discrete algorithms. pp. 932- 941 ,(2008)
Christian Sohler, David P. Woodruff, Subspace embeddings for the L1-norm with applications symposium on the theory of computing. pp. 755- 764 ,(2011) , 10.1145/1993636.1993736
Petros Drineas, Ravi Kannan, Michael W. Mahoney, Fast Monte Carlo Algorithms for Matrices II: Computing a Low-Rank Approximation to a Matrix SIAM Journal on Computing. ,vol. 36, pp. 158- 183 ,(2006) , 10.1137/S0097539704442696
Mark Rudelson, Roman Vershynin, Sampling from large matrices Journal of the ACM. ,vol. 54, pp. 21- ,(2007) , 10.1145/1255443.1255449
Petros Drineas, Ravi Kannan, Michael W. Mahoney, Fast Monte Carlo Algorithms for Matrices III: Computing a Compressed Approximate Matrix Decomposition SIAM Journal on Computing. ,vol. 36, pp. 184- 206 ,(2006) , 10.1137/S0097539704442702
Petros Drineas, Michael W. Mahoney, S. Muthukrishnan, Tamás Sarlós, Faster least squares approximation Numerische Mathematik. ,vol. 117, pp. 219- 249 ,(2011) , 10.1007/S00211-010-0331-6