Nonlinear Learning using Local Coordinate Coding

作者: Kai Yu , Yihong Gong , Tong Zhang

DOI:

关键词:

摘要: This paper introduces a new method for semi-supervised learning on high dimensional nonlinear manifolds, which includes a phase of unsupervised basis learning and a phase of supervised function learning. The learned bases provide a set of anchor points to form a local coordinate system, such that each data point x on the manifold can be locally approximated by a linear combination of its nearby anchor points, and the linear weights become its local coordinate coding. We show that a high dimensional nonlinear function can …

参考文章(12)
Trevor Hastie, Clive Loader, Local Regression: Automatic Kernel Carpentry Statistical Science. ,vol. 8, pp. 120- 129 ,(1993) , 10.1214/SS/1177011002
Joshua B Tenenbaum, Vin de Silva, John C Langford, A Global Geometric Framework for Nonlinear Dimensionality Reduction Science. ,vol. 290, pp. 2319- 2323 ,(2000) , 10.1126/SCIENCE.290.5500.2319
Sam T Roweis, Lawrence K Saul, Nonlinear Dimensionality Reduction by Locally Linear Embedding Science. ,vol. 290, pp. 2323- 2326 ,(2000) , 10.1126/SCIENCE.290.5500.2323
Léon Bottou, Vladimir Vapnik, Local learning algorithms Neural Computation. ,vol. 4, pp. 888- 900 ,(1992) , 10.1162/NECO.1992.4.6.888
Mikhail Belkin, Partha Niyogi, Laplacian Eigenmaps for dimensionality reduction and data representation Neural Computation. ,vol. 15, pp. 1373- 1396 ,(2003) , 10.1162/089976603321780317
Geoffrey E Hinton, Ruslan R Salakhutdinov, Reducing the Dimensionality of Data with Neural Networks Science. ,vol. 313, pp. 504- 507 ,(2006) , 10.1126/SCIENCE.1127647
Marc'aurelio Ranzato, Yann L. Cun, Y-lan Boureau, Sparse Feature Learning for Deep Belief Networks neural information processing systems. ,vol. 20, pp. 1185- 1192 ,(2007)
Alexis Battle, Andrew Y. Ng, Honglak Lee, Rajat Raina, Efficient sparse coding algorithms neural information processing systems. ,vol. 19, pp. 801- 808 ,(2006)
Rajat Raina, Alexis Battle, Honglak Lee, Benjamin Packer, Andrew Y. Ng, Self-taught learning: transfer learning from unlabeled data international conference on machine learning. pp. 759- 766 ,(2007) , 10.1145/1273496.1273592
Julien Mairal, Guillermo Sapiro, Francis R. Bach, Jean Ponce, Andrew Zisserman, Supervised Dictionary Learning neural information processing systems. ,vol. 21, pp. 1033- 1040 ,(2008)