Statistical Mechanics of On-line Ensemble Teacher Learning through a Novel Perceptron Learning Rule

作者: Seiji Miyoshi , Kazuyuki Hara

DOI: 10.1143/JPSJ.81.064002

关键词:

摘要: In ensemble teacher learning, teachers have only uncertain information about the true teacher, and this is given by an consisting of infinite number whose variety sufficiently rich. a student learns from that iteratively selected randomly pool many teachers. An interesting point learning asymptotic behavior to approach The performance improved using Hebbian rule in learning. However, perceptron cannot improve performance. On other hand, we proposed with margin. This identical when margin zero infinity. Thus, connects cont...

参考文章(8)
Donald O. Hebb, The organization of behavior Neurocomputing: foundations of research. pp. 43- 54 ,(1988)
Seiji Miyoshi, Masato Okada, Statistical Mechanics of Online Learning for Ensemble Teachers Journal of the Physical Society of Japan. ,vol. 75, pp. 044002- 044002 ,(2006) , 10.1143/JPSJ.75.044002
Yoav Freund, Robert E Schapire, A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting conference on learning theory. ,vol. 55, pp. 119- 139 ,(1997) , 10.1006/JCSS.1997.1504
Kazuyuki Hara, Yoichi Nakayama, Seiji Miyoshi, Masato Okada, Statistical Mechanics of On-Line Mutual Learning with Many Linear Perceptrons Journal of the Physical Society of Japan. ,vol. 78, pp. 114001- ,(2009) , 10.1143/JPSJ.78.114001
Kazuyuki Hara, Masato Okada, On-line learning through simple perceptron learning with a margin Neural Networks. ,vol. 17, pp. 215- 223 ,(2004) , 10.1016/J.NEUNET.2003.08.005
Noboru Murata, Takashi Takenouchi, Takafumi Kanamori, Shinto Eguchi, Information geometry of U-Boost and Bregman divergence Neural Computation. ,vol. 16, pp. 1437- 1481 ,(2004) , 10.1162/089976604323057452
Seiji Miyoshi, Hideto Utsumi, Masato Okada, Statistical Mechanics of Nonlinear On-line Learning for Ensemble Teachers Journal of the Physical Society of Japan. ,vol. 76, pp. 114001- ,(2007) , 10.1143/JPSJ.76.114001