Deep learning with COTS HPC systems

作者: Brody Huval , Ng Andrew , Adam Coates , David Wu , Tao Wang

DOI:

关键词:

摘要: … Our system trains neural networks at scales comparable to … in a single server (which share a highspeed bus) (Krizhevsky… 2012), we tested each neuron in the trained network by …

参考文章(29)
Geoffrey E. Hinton, A Practical Guide to Training Restricted Boltzmann Machines Neural Networks: Tricks of the Trade (2nd ed.). pp. 599- 619 ,(2012) , 10.1007/978-3-642-35289-8_32
James Martens, Deep learning via Hessian-free optimization international conference on machine learning. pp. 735- 742 ,(2010)
David E. Rumelhart, Geoffrey E. Hinton, Ronald J. Williams, Learning representations by back-propagating errors Nature. ,vol. 323, pp. 696- 699 ,(1988) , 10.1038/323533A0
Marwan Mattar, Tamara Berg, Gary B. Huang, Eric Learned-Miller, Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments Workshop on Faces in 'Real-Life' Images: Detection, Alignment, and Recognition. ,(2008)
Hao Wang, Sreeram Potluri, Miao Luo, Ashish Kumar Singh, Sayantan Sur, Dhabaleswar K. Panda, MVAPICH2-GPU: optimized GPU to GPU communication for InfiniBand clusters Computer Science - Research and Development. ,vol. 26, pp. 257- 266 ,(2011) , 10.1007/S00450-011-0171-3
Andrew Y. Ng, Jiquan Ngiam, Adam Coates, Quoc V. Le, Ahbik Lahiri, Bobby Prochnow, On optimization methods for deep learning international conference on machine learning. pp. 265- 272 ,(2011)
D. H. Hubel, T. N. Wiesel, Receptive fields of single neurones in the cat's striate cortex The Journal of Physiology. ,vol. 148, pp. 574- 591 ,(1959) , 10.1113/JPHYSIOL.1959.SP006308
Andrej Karpathy, Andrew Y. Ng, Adam Coates, Emergence of Object-Selective Features in Unsupervised Feature Learning neural information processing systems. ,vol. 25, pp. 2681- 2689 ,(2012)
Rafael Uetz, Sven Behnke, Large-scale object recognition with CUDA-accelerated hierarchical neural networks international conference on intelligent computing. ,vol. 1, pp. 536- 541 ,(2009) , 10.1109/ICICISYS.2009.5357786
Cheng-tao Chu, Sang Kim, Yi-An Lin, YuanYuan Yu, Gary Bradski, Kunle Olukotun, Andrew Ng, None, Map-Reduce for Machine Learning on Multicore neural information processing systems. ,vol. 19, pp. 281- 288 ,(2006)