Increasing the Power of Connectionist Networks (CN) by Improving Structures, Processes, Learning

作者: LEONARD UHR

DOI: 10.1080/09540099008915668

关键词: Convergence (routing)Artificial neural networkComputer scienceMatching (statistics)Divergence (computer science)DilemmaConnectionismArtificial intelligenceVariety (cybernetics)Simple (philosophy)

摘要: A crucial dilemma is how to increase the power of connectionist networks (CN), since simply increasing size today's relatively small CNs often slows down and worsens learning performance. There are three possible ways: (1) use more powerful structures; (2) amount stored information, variety basic processes; (3) have network modify itself (learn, evolve) in ways. Today's only a few many topological structures, handle numerical values using very simple processes, learn by modifying weights associated with links. This paper examines great potentially muck possibilities, focusing on what appear be most promising: appropriate brain-like structures (e.g. local connectivity, global convergence divergence); matching, symbol-handling, list-manipulating capabilities; extraction-generation-discovery.

参考文章(19)
L. Uhr, Highly parallel, hierarchical, recognition cone perceptual structures Parallel computer vision. pp. 249- 292 ,(1987)
C. A. Petri, Introduction to General Net Theory Proceedings of the Advanced Course on General Net Theory of Processes and Systems: Net Theory and Applications. pp. 1- 19 ,(1979) , 10.1007/3-540-10001-6_21
John G Nicholls, A Robert Martin, Bruce G Wallace, Paul A Fuchs, None, From neuron to brain ,(1976)
Warren S. McCulloch (pr.), Embodiments of Mind ,(1965)
T. J. Sejnowski, Parallel networks that learn to pronounce English text Complex Systems. ,vol. 1, pp. 145- 168 ,(1987)
David E. Rumelhart, James L. McClelland, , Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations Computational Models of Cognition and Perception. ,(1986) , 10.7551/MITPRESS/5236.001.0001
William T. Greenough, James E. Black, Christopher S. Wallace, Experience and brain development. Child Development. ,vol. 58, pp. 539- 559 ,(1987) , 10.2307/1130197
Jerome A. Feldman, Dynamic connections in neural networks Biological Cybernetics. ,vol. 47, pp. 48- 62 ,(1990) , 10.1007/BF00340071
William T. Greenough, Craig H. Bailey, The anatomy of a memory: convergence of results across a diversity of tests Trends in Neurosciences. ,vol. 11, pp. 142- 147 ,(1988) , 10.1016/0166-2236(88)90139-7