Regularization of Neural Networks using DropConnect
作者： Matthew Zeiler , Rob Fergus , Li Wan , Yann Le Cun , Sixin Zhang
DOI:
关键词:
摘要: … The error is then backpropagated only through the remaining … DropConnect which generalizes Dropout by randomly dropping … Now we reformulate the cross-entropy loss on top of the …
matthewzeiler.com
acm.org 参考文章(13)
Michel Ledoux, Michel Talagrand, Probability in Banach spaces ,(1991)
D. Panchenko, V. Koltchinskii, Empirical margin distributions and bounding the generalization error of combined classifiers Annals of Statistics. ,vol. 30, pp. 1- 50 ,(2002) , 10.1214/AOS/1015362183
Geoffrey E. Hinton, Vinod Nair, Rectified Linear Units Improve Restricted Boltzmann Machines international conference on machine learning. pp. 807- 814 ,(2010)
Ilya Sutskever, Geoffrey E. Hinton, Alex Krizhevsky, Ruslan R. Salakhutdinov, Nitish Srivastava, Improving neural networks by preventing co-adaptation of feature detectors arXiv: Neural and Evolutionary Computing. ,(2012)
Matthew D. Zeiler, Rob Fergus, Stochastic Pooling for Regularization of Deep Convolutional Neural Networks arXiv: Learning. ,(2013)
Y. Lecun, L. Bottou, Y. Bengio, P. Haffner, Gradient-based learning applied to document recognition Proceedings of the IEEE. ,vol. 86, pp. 2278- 2324 ,(1998) , 10.1109/5.726791
Hugo Larochelle, Jasper Snoek, Ryan P Adams, Practical Bayesian Optimization of Machine Learning Algorithms neural information processing systems. ,vol. 25, pp. 2951- 2959 ,(2012)
Y. LeCun, Fu Jie Huang, L. Bottou, Learning methods for generic object recognition with invariance to pose and lighting Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004.. ,vol. 2, pp. 97- 104 ,(2004) , 10.1109/CVPR.2004.1315150
David J C Mackay, Probable networks and plausible predictions - a review of practical Bayesian methods for supervised neural networks Network: Computation In Neural Systems. ,vol. 6, pp. 469- 505 ,(1995) , 10.1088/0954-898X_6_3_011
D. Ciresan, U. Meier, J. Schmidhuber, Multi-column deep neural networks for image classification computer vision and pattern recognition. pp. 3642- 3649 ,(2012) , 10.1109/CVPR.2012.6248110