The power of sparsity in convolutional neural networks

作者: Andrey Zhmoginov , Mark Sandler , Soravit Changpinyo

DOI:

关键词:

摘要: Deep convolutional networks are well-known for their high computational and memory demands. Given limited resources, how does one design a network that balances its size …

参考文章(9)
Matthew Zeiler, Rob Fergus, Li Wan, Yann Le Cun, Sixin Zhang, Regularization of Neural Networks using DropConnect international conference on machine learning. pp. 1058- 1066 ,(2013)
Ilya Sutskever, Geoffrey E. Hinton, Alex Krizhevsky, Ruslan R. Salakhutdinov, Nitish Srivastava, Improving neural networks by preventing co-adaptation of feature detectors arXiv: Neural and Evolutionary Computing. ,(2012)
Julien Mairal, Francis Bach, Jean Ponce, Guillermo Sapiro, Online dictionary learning for sparse coding Proceedings of the 26th Annual International Conference on Machine Learning - ICML '09. pp. 689- 696 ,(2009) , 10.1145/1553374.1553463
Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, Li Fei-Fei, ImageNet: A large-scale hierarchical image database computer vision and pattern recognition. pp. 248- 255 ,(2009) , 10.1109/CVPR.2009.5206848
Y. Lecun, L. Bottou, Y. Bengio, P. Haffner, Gradient-based learning applied to document recognition Proceedings of the IEEE. ,vol. 86, pp. 2278- 2324 ,(1998) , 10.1109/5.726791
Olga Russakovsky, Jia Deng, Hao Su, Jonathan Krause, Sanjeev Satheesh, Sean Ma, Zhiheng Huang, Andrej Karpathy, Aditya Khosla, Michael Bernstein, Alexander C. Berg, Li Fei-Fei, ImageNet Large Scale Visual Recognition Challenge International Journal of Computer Vision. ,vol. 115, pp. 211- 252 ,(2015) , 10.1007/S11263-015-0816-Y
Kaiming He, Xiangyu Zhang, Shaoqing Ren, Jian Sun, Deep Residual Learning for Image Recognition computer vision and pattern recognition. pp. 770- 778 ,(2016) , 10.1109/CVPR.2016.90
Kaiming He, Xiangyu Zhang, Shaoqing Ren, Jian Sun, Identity Mappings in Deep Residual Networks Computer Vision – ECCV 2016. pp. 630- 645 ,(2016) , 10.1007/978-3-319-46493-0_38
Marco Andreetto, Tobias Weyand, Hartwig Adam, Menglong Zhu, Dmitry Kalenichenko, Bo Chen, Andrew G. Howard, Weijun Wang, MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications arXiv: Computer Vision and Pattern Recognition. ,(2017)