Deep Coding Network
作者： Shenghuo Zhu , Yuanqing Lin , Kai Yu , Zhang Tong
DOI:
关键词: Functional approximation 、 Linear network coding 、 Nonlinear system 、 Improved performance 、 Theoretical computer science 、 Neural coding 、 Coding (social sciences) 、 Mathematics
摘要: This paper proposes a principled extension of the traditional single-layer flat sparse coding scheme, where two-layer scheme is derived based on theoretical analysis nonlinear functional approximation that extends recent results for local coordinate coding. The approach can be easily generalized to deeper structures in hierarchical multiple-layer manner. Empirically, it shown deep yields improved performance benchmark datasets.
nips.cc参考文章(15)
Jianchao Yang, Kai Yu, Yihong Gong, Thomas Huang, Linear spatial pyramid matching using sparse coding for image classification computer vision and pattern recognition. pp. 1794- 1801 ,(2009) , 10.1109/CVPR.2009.5206757
Geoffrey E Hinton, Ruslan R Salakhutdinov, Reducing the Dimensionality of Data with Neural Networks Science. ,vol. 313, pp. 504- 507 ,(2006) , 10.1126/SCIENCE.1127647
Marc'aurelio Ranzato, Yann L. Cun, Y-lan Boureau, Sparse Feature Learning for Deep Belief Networks neural information processing systems. ,vol. 20, pp. 1185- 1192 ,(2007)
Alexis Battle, Andrew Y. Ng, Honglak Lee, Rajat Raina, Efficient sparse coding algorithms neural information processing systems. ,vol. 19, pp. 801- 808 ,(2006)
Kai Yu, Tong Zhang, Improved Local Coordinate Coding using Local Tangents international conference on machine learning. pp. 1215- 1222 ,(2010)
Rajat Raina, Alexis Battle, Honglak Lee, Benjamin Packer, Andrew Y. Ng, Self-taught learning: transfer learning from unlabeled data international conference on machine learning. pp. 759- 766 ,(2007) , 10.1145/1273496.1273592
Julien Mairal, Guillermo Sapiro, Francis R. Bach, Jean Ponce, Andrew Zisserman, Supervised Dictionary Learning neural information processing systems. ,vol. 21, pp. 1033- 1040 ,(2008)
J. A. Bagnell, David M. Bradley, Differentiable Sparse Coding neural information processing systems. ,vol. 21, pp. 113- 120 ,(2008)
Kai Yu, Yihong Gong, Tong Zhang, Nonlinear Learning using Local Coordinate Coding neural information processing systems. ,vol. 22, pp. 2223- 2231 ,(2009)
Michael S. Lewicki, Terrence J. Sejnowski, Learning Overcomplete Representations Neural Computation. ,vol. 12, pp. 337- 365 ,(2000) , 10.1162/089976600300015826