High Dimensional Nonlinear Learning using Local Coordinate Coding

作者: Kai Yu , Tong Zhang

DOI:

关键词:

摘要: This paper introduces a new method for semi-supervised learning on high dimensional nonlinear manifolds, which includes a phase of unsupervised basis learning and a phase of supervised function learning. The learned bases provide a set of anchor points to form a local coordinate system, such that each data point $ x $ on the manifold can be locally approximated by a linear combination of its nearby anchor points, with the linear weights offering a local-coordinate coding of $ x $. We show that a high dimensional nonlinear …

参考文章(8)
Joshua B Tenenbaum, Vin de Silva, John C Langford, A Global Geometric Framework for Nonlinear Dimensionality Reduction Science. ,vol. 290, pp. 2319- 2323 ,(2000) , 10.1126/SCIENCE.290.5500.2319
Tong Zhang, Leave-one-out bounds for kernel methods Neural Computation. ,vol. 15, pp. 1397- 1437 ,(2003) , 10.1162/089976603321780326
Sam T Roweis, Lawrence K Saul, Nonlinear Dimensionality Reduction by Locally Linear Embedding Science. ,vol. 290, pp. 2323- 2326 ,(2000) , 10.1126/SCIENCE.290.5500.2323
Mikhail Belkin, Partha Niyogi, Laplacian Eigenmaps for dimensionality reduction and data representation Neural Computation. ,vol. 15, pp. 1373- 1396 ,(2003) , 10.1162/089976603321780317
Geoffrey E Hinton, Ruslan R Salakhutdinov, Reducing the Dimensionality of Data with Neural Networks Science. ,vol. 313, pp. 504- 507 ,(2006) , 10.1126/SCIENCE.1127647
Rajat Raina, Alexis Battle, Honglak Lee, Benjamin Packer, Andrew Y. Ng, Self-taught learning: transfer learning from unlabeled data international conference on machine learning. pp. 759- 766 ,(2007) , 10.1145/1273496.1273592
Ya'acov Ritov, Alon Zakai, Consistency and Localizability Journal of Machine Learning Research. ,vol. 10, pp. 827- 856 ,(2009)
S. Lazebnik, C. Schmid, J. Ponce, Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories computer vision and pattern recognition. ,vol. 2, pp. 2169- 2178 ,(2006) , 10.1109/CVPR.2006.68