On the Reproducibility of Neural Network Predictions

作者: Srinadh Bhojanapalli , Andreas Veit , Aditya Krishna Menon , Ankit Singh Rawat , Seungyeon Kim

DOI:

关键词: Contextual image classificationMachine learningComputer scienceArtificial intelligenceArtificial neural networkReduction (complexity)

摘要: Standard training techniques for neural networks involve multiple sources of randomness, eg, initialization, mini-batch ordering and in some cases data augmentation. Given that …

参考文章(34)
Thomas G. Dietterich, Ensemble Methods in Machine Learning Multiple Classifier Systems. pp. 1- 15 ,(2000) , 10.1007/3-540-45014-9_1
Joaquin Vanschoren, Mikio L. Braun, Cheng Soon Ong, Open science in machine learning arXiv: Learning. ,(2014)
Jonathan B. Buckheit, David L. Donoho, WaveLab and Reproducible Research Wavelets and Statistics. pp. 55- 81 ,(1995) , 10.1007/978-1-4612-2544-7_5
Geoffrey Hinton, Oriol Vinyals, Jeff Dean, Distilling the Knowledge in a Neural Network arXiv: Machine Learning. ,(2015)
R. D. Peng, Reproducible Research in Computational Science Science. ,vol. 334, pp. 1226- 1227 ,(2011) , 10.1126/SCIENCE.1213847
J. P. Mesirov, Accessible Reproducible Research Science. ,vol. 327, pp. 415- 416 ,(2010) , 10.1126/SCIENCE.1179653
Robert Gentleman, Duncan Temple Lang, Statistical Analyses and Reproducible Research Journal of Computational and Graphical Statistics. ,vol. 16, pp. 1- 23 ,(2007) , 10.1198/106186007X178663
Gunnar Rätsch, Bernhard Schölkopf, Leon Bottou, Alexander Smola, Sören Sonnenburg, Klaus-Robert Müller, Samy Bengio, Yann LeCun, Jason Weston, Robert Williamson, Carl Edward Rasmussen, Geoffrey Holmes, Mikio L. Braun, Fernando Pereira, Pascal Vincent, Cheng Soon Ong, The Need for Open Source Software in Machine Learning Journal of Machine Learning Research. ,vol. 8, pp. 2443- 2466 ,(2007) , 10.5555/1314498.1314577
Jelena Kovacevic, How to Encourage and Publish Reproducible Research international conference on acoustics, speech, and signal processing. ,vol. 4, pp. 1273- 1276 ,(2007) , 10.1109/ICASSP.2007.367309
Yves Grandvalet, Yoshua Bengio, Semi-supervised Learning by Entropy Minimization neural information processing systems. ,vol. 17, pp. 529- 536 ,(2004)