Learning algorithms in neural networks: recent results

作者: Marc Mézard

DOI: 10.1007/978-3-642-76153-9_8

关键词:

摘要: We review two new algorithms for learning in neural networks of Boolean units. The first applies to the problem associative memory: Hopfield model or perception. algorithm optimizes stability learned patterns, which enlarges size basins attraction. second builds a multilayer feedforward network: it allows one learn an arbitrary mapping input → output. convergence growth process is guaranteed. generalization properties look very promising.

参考文章(11)
Marc Mézard, Jean-Pierre Nadal, Werner Krauth, Basins of attraction in a perceptron-like neural network Complex Systems. ,vol. 2, pp. 387- 408 ,(1988)
Ben S. Wittner, John J. Hopfield, Sara A. Solla, Lawrence D. Jackel, John S. Denker, Daniel B. Schwartz, Richard E. Howard, Large Automatic Learning, Rule Extraction, and Generalization. Complex Systems. ,vol. 1, ,(1987)
P Carnevali, S Patarnello, Exhaustive Thermodynamical Analysis of Boolean Learning Networks EPL. ,vol. 4, pp. 1199- 1204 ,(1987) , 10.1209/0295-5075/4/10/020
E Gardner, B Derrida, Optimal storage properties of neural network models Journal of Physics A. ,vol. 21, pp. 271- 284 ,(1988) , 10.1088/0305-4470/21/1/031
Jean-Pierre Nadal, STUDY OF A GROWTH ALGORITHM FOR A FEEDFORWARD NETWORK International Journal of Neural Systems. ,vol. 01, pp. 55- 59 ,(1989) , 10.1142/S0129065789000463
M Mezard, Jean-P Nadal, Learning in feedforward layered networks: the tiling algorithm Journal of Physics A. ,vol. 22, pp. 2191- 2203 ,(1989) , 10.1088/0305-4470/22/12/019
W Krauth, M Mezard, Learning algorithms with optimal stability in neural networks Journal of Physics A. ,vol. 20, ,(1987) , 10.1088/0305-4470/20/11/013
E J Gardner, D J Wallace, N Stroud, Training with noise and the storage of correlated patterns in a neural network model Journal of Physics A. ,vol. 22, pp. 2019- 2030 ,(1989) , 10.1088/0305-4470/22/12/007
B M Forrest, Content-addressability and learning in neural networks Journal of Physics A. ,vol. 21, pp. 245- 255 ,(1988) , 10.1088/0305-4470/21/1/029
E Gardner, Maximum Storage Capacity in Neural Networks EPL. ,vol. 4, pp. 481- 485 ,(1987) , 10.1209/0295-5075/4/4/016