Machine Learning for Multi-stage Selection of Numerical Methods

作者: Victor Eijkhout , Erika Fuentes

DOI: 10.5772/9376

关键词: Learning classifier systemUnsupervised learningOnline machine learningComputational learning theoryEnsemble learningArtificial intelligenceAlgorithmic learning theoryMachine learningSolverActive learning (machine learning)Computer science

摘要: In various areas of numerical analysis, there are several possible algorithms for solving a problem. such cases, each method potentially solves the problem, but runtimes can widely differ, and breakdown is possible. Also, typically no governing theory finding best method, or in essence uncomputable. Thus, choice optimal practice determined by experimentation ‘numerical folklore’. However, more systematic approach needed, instance since choices may need to be made dynamic context as time-evolving system. Thus we formulate this classification problem: assign problem class corresponding that What makes an interesting Machine Learning, large number classes, their relationships. A combination (at least) preconditioner iterative scheme, making total methods product these individual cardinalities. Since very number, want exploit structure set find way classify components separately. We have developed techniques multi-stage recommendations, using automatic recognition super-clases. These shown pay off well our application area linear system solvers. present basic concepts recommendation strategy, give overview software libraries make up Salsa (Self-Adapting Large-scale Solver Architecture) project.

参考文章(22)
Jack Dongarra, Susan Blackford, Dorian Arnold, Victor Eijkhout, Tinghua Xu, Seamless Access to Adaptive Solver Algorithms Proceedings of 16th IMACS World Congress 2000 on Scientific Computing, Applications Mathematics and Simulation. ,(2000)
Robert D. Falgout, Jim E. Jones, Ulrike Meier Yang, The Design and Implementation of hypre, a Library of Parallel High Performance Preconditioners computational science and engineering. ,vol. 51, pp. 267- 294 ,(2006) , 10.1007/3-540-31619-1_8
J. Choi, J.J. Dongarra, R. Pozo, D.W. Walker, ScaLAPACK: a scalable linear algebra library for distributed memory concurrent computers symposium on frontiers of massively parallel computation. pp. 120- 127 ,(1992) , 10.1109/FMPC.1992.234898
R. Clint Whaley, Antoine Petitet, Jack J. Dongarra, New trends in high performance computing ieee international conference on high performance computing data and analytics. ,vol. 27, pp. 3- 35 ,(2001) , 10.1016/S0167-8191(00)00087-9
Anne Greenbaum, Vlastimil Pták, Zdenvk Strakoš, Any Nonincreasing Convergence Curve is Possible for GMRES SIAM Journal on Matrix Analysis and Applications. ,vol. 17, pp. 465- 469 ,(1996) , 10.1137/S0895479894275030
Qing Yi, Ken Kennedy, Haihang You, Keith Seymour, Jack Dongarra, Automatic blocking of QR and LU factorizations for locality Proceedings of the 2004 workshop on Memory system performance - MSP '04. pp. 12- 22 ,(2004) , 10.1145/1065895.1065898
T. A. Manteuffel, An incomplete factorization technique for positive definite linear systems Mathematics of Computation. ,vol. 34, pp. 473- 497 ,(1980) , 10.1090/S0025-5718-1980-0559197-0