A kernelized maximal-figure-of-merit learning approach based on subspace distance minimization

作者: Byungki Byun , Chin-Hui Lee

DOI: 10.1109/ICASSP.2011.5946732

关键词:

摘要: We propose a kernelized maximal-figure-of-merit (MFoM) learning approach to efficiently training nonlinear model using subspace distance minimization. In particular, fixed, small number of samples are chosen in way that the between function spaces constructed with subset and entire data set is minimized. This construction enables us learn while keeping resulting nearly optimal compared from whole set. show can be minimized through Nystrom extension. Experimental results on various machine problems demonstrate clear advantages proposed technique over case where space built randomly selected samples. Additional comparisons trained achieves comparable reducing time tremendously.

参考文章(13)
T. Scheffer, U. Brefeld, {AUC} maximizing support vector learning ,(2005)
Semi-Supervised Learning Advanced Methods in Sequence Analysis Lectures. pp. 221- 232 ,(2010) , 10.7551/MITPRESS/9780262033589.001.0001
Mark Schmidt, Glenn Fung, Rómer Rosales, Fast Optimization Methods for L1 Regularization: A Comparative Study and Two New Approaches european conference on machine learning. pp. 286- 297 ,(2007) , 10.1007/978-3-540-74958-5_28
John C. Platt, Fast training of support vector machines using sequential minimal optimization Advances in kernel methods. pp. 185- 208 ,(1999)
M.-A. Belabbas, P. J. Wolfe, Spectral methods in machine learning and new strategies for very large datasets. Proceedings of the National Academy of Sciences of the United States of America. ,vol. 106, pp. 369- 374 ,(2009) , 10.1073/PNAS.0810600105
Liwei Wang, Xiao Wang, Jufu Feng, Subspace distance analysis with application to adaptive Bayesian algorithm for face recognition Pattern Recognition. ,vol. 39, pp. 456- 464 ,(2006) , 10.1016/J.PATCOG.2005.08.015
Thorsten Joachims, A support vector method for multivariate performance measures Proceedings of the 22nd international conference on Machine learning - ICML '05. pp. 377- 384 ,(2005) , 10.1145/1102351.1102399
Matthias Seeger, Christopher K. I. Williams, Using the Nyström Method to Speed Up Kernel Machines neural information processing systems. ,vol. 13, pp. 682- 688 ,(2000)
C. Fowlkes, S. Belongie, Fan Chung, J. Malik, Spectral grouping using the Nystrom method IEEE Transactions on Pattern Analysis and Machine Intelligence. ,vol. 26, pp. 214- 225 ,(2004) , 10.1109/TPAMI.2004.1262185
Sheng Gao, Wen Wu, Chin-Hui Lee, Tat-Seng Chua, A MFoM learning approach to robust multiclass multi-label text categorization international conference on machine learning. pp. 42- ,(2004) , 10.1145/1015330.1015361