Identity Mappings in Deep Residual Networks
作者： Kaiming He , Xiangyu Zhang , Shaoqing Ren , Jian Sun
DOI: 10.1007/978-3-319-46493-0_38
关键词: Block (data storage) 、 Residual neural network 、 Identity (object-oriented programming) 、 Series (mathematics) 、 Mathematics 、 Algorithm 、 Generalization 、 Code (cryptography) 、 Residual 、 Convergence (routing)
摘要: … , we analyze deep residual networks by … residual unit, but through the entire network. Our derivations reveal that if both \(h(\mathbf {x}_{l})\) and \(f(\mathbf {y}_{l})\) are identity mappings, …
arxiv-vanity.com
core.ac.uk
springer.com
arxiv.org 参考文章(22)
Geoffrey E. Hinton, Vinod Nair, Rectified Linear Units Improve Restricted Boltzmann Machines international conference on machine learning. pp. 807- 814 ,(2010)
Kaiming He, Xiangyu Zhang, Shaoqing Ren, Jian Sun, Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification international conference on computer vision. pp. 1026- 1034 ,(2015) , 10.1109/ICCV.2015.123
Tsung-Yi Lin, Michael Maire, Serge Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Dollár, C. Lawrence Zitnick, Microsoft COCO: Common Objects in Context Computer Vision – ECCV 2014. pp. 740- 755 ,(2014) , 10.1007/978-3-319-10602-1_48
Ilya Sutskever, Geoffrey E. Hinton, Alex Krizhevsky, Ruslan R. Salakhutdinov, Nitish Srivastava, Improving neural networks by preventing co-adaptation of feature detectors arXiv: Neural and Evolutionary Computing. ,(2012)
Sepp Hochreiter, Jürgen Schmidhuber, Long short-term memory Neural Computation. ,vol. 9, pp. 1735- 1780 ,(1997) , 10.1162/NECO.1997.9.8.1735
M Sai Praneeth, Xudong Peng, Alice Li, Shahrzad Hosseini Vajargah, Going deeper with convolutions computer vision and pattern recognition. pp. 1- 9 ,(2015) , 10.1109/CVPR.2015.7298594
Olga Russakovsky, Jia Deng, Hao Su, Jonathan Krause, Sanjeev Satheesh, Sean Ma, Zhiheng Huang, Andrej Karpathy, Aditya Khosla, Michael Bernstein, Alexander C. Berg, Li Fei-Fei, ImageNet Large Scale Visual Recognition Challenge International Journal of Computer Vision. ,vol. 115, pp. 211- 252 ,(2015) , 10.1007/S11263-015-0816-Y
Jost Tobias Springenberg, Alexey Dosovitskiy, Martin Riedmiller, Thomas Brox, Striving for Simplicity: The All Convolutional Net arXiv: Learning. ,(2014)
Benjamin Graham, Fractional Max-Pooling arXiv: Computer Vision and Pattern Recognition. ,(2014)
Yann LeCun, Bernhard Boser, John S Denker, Donnie Henderson, Richard E Howard, Wayne Hubbard, Lawrence D Jackel, None, Backpropagation applied to handwritten zip code recognition Neural Computation. ,vol. 1, pp. 541- 551 ,(1989) , 10.1162/NECO.1989.1.4.541