Discriminative Unsupervised Feature Learning with Convolutional Neural Networks

作者: Jost Tobias Springenberg , Alexey Dosovitskiy , Martin Riedmiller , Thomas Brox

DOI:

关键词:

摘要: Current methods for training convolutional neural networks depend on large amounts of labeled samples supervised training. In this paper we present an approach a network using only unlabeled data. We train the to discriminate between set surrogate classes. Each class is formed by applying variety transformations randomly sampled 'seed' image patch. find that simple feature learning algorithm surprisingly successful when applied visual object recognition. The representation learned our achieves classification results matching or outperforming current state-of-the-art unsupervised several popular datasets (STL-10, CIFAR-10, Caltech-101).

参考文章(32)
Massih-Reza Amini, Patrick Gallinari, Semi-supervised logistic regression european conference on artificial intelligence. pp. 390- 394 ,(2002)
Amr Ahmed, Kai Yu, Wei Xu, Yihong Gong, Eric Xing, Training Hierarchical Feed-Forward Visual Recognition Models Using Transfer Learning from Pseudo-Tasks european conference on computer vision. pp. 69- 82 ,(2008) , 10.1007/978-3-540-88690-7_6
Liefeng Bo, Xiaofeng Ren, Dieter Fox, Unsupervised Feature Learning for RGB-D Based Object Recognition Experimental Robotics. pp. 387- 402 ,(2013) , 10.1007/978-3-319-00065-7_27
Matthew D. Zeiler, Rob Fergus, Visualizing and Understanding Convolutional Networks european conference on computer vision. pp. 818- 833 ,(2014) , 10.1007/978-3-319-10590-1_53
Ilya Sutskever, Geoffrey E. Hinton, Alex Krizhevsky, Ruslan R. Salakhutdinov, Nitish Srivastava, Improving neural networks by preventing co-adaptation of feature detectors arXiv: Neural and Evolutionary Computing. ,(2012)
Pascal Vincent, Hugo Larochelle, Yoshua Bengio, Pierre-Antoine Manzagol, Extracting and composing robust features with denoising autoencoders Proceedings of the 25th international conference on Machine learning - ICML '08. pp. 1096- 1103 ,(2008) , 10.1145/1390156.1390294
Ross Girshick, Jeff Donahue, Trevor Darrell, Jitendra Malik, Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation computer vision and pattern recognition. pp. 580- 587 ,(2014) , 10.1109/CVPR.2014.81
Liefeng Bo, Xiaofeng Ren, Dieter Fox, Multipath Sparse Coding Using Hierarchical Matching Pursuit computer vision and pattern recognition. pp. 660- 667 ,(2013) , 10.1109/CVPR.2013.91
Ka Yu Hui, Direct Modeling of Complex Invariances for Visual Object Features international conference on machine learning. pp. 352- 360 ,(2013)
Shenghuo Zhu, Will Zou, Andrew Y. Ng, Kai Yu, Deep Learning of Invariant Features via Simulated Fixations in Video neural information processing systems. ,vol. 25, pp. 3203- 3211 ,(2012)