Statistical Mechanics of Linear and Nonlinear Time-Domain Ensemble Learning

作者: Seiji Miyoshi , Masato Okada

DOI: 10.1143/JPSJ.75.124002

关键词:

摘要: Conventional ensemble learning combines students in the space domain. In this paper, however, we combine time domain and call it time-domain learning. We analyze, compare, discuss generalization performances regarding of both a linear model nonlinear model. Analyzing framework online using statistical mechanical method, show qualitatively different behaviors between two models. model, dynamical error are monotonic. analytically that is twice as effective conventional Furthermore, features nonmonotonic when rate small. numerically performance can be improved remarkably by phenomenon divergence

参考文章(18)
Yoshiyuki Kabashima, Hidetoshi Nishimori, Jun-ichi Inoue, A Simple Perceptron that Learns Non-Monotonic Rules arXiv: Disordered Systems and Neural Networks. ,(1997)
Anders Krogh, Peter Sollich, Statistical mechanics of ensemble learning Physical Review E. ,vol. 55, pp. 811- 825 ,(1997) , 10.1103/PHYSREVE.55.811
Seiji Miyoshi, Masato Okada, Statistical Mechanics of Online Learning for Ensemble Teachers Journal of the Physical Society of Japan. ,vol. 75, pp. 044002- 044002 ,(2006) , 10.1143/JPSJ.75.044002
Yoav Freund, Robert E. Schapire, Large margin classification using the perceptron algorithm conference on learning theory. ,vol. 37, pp. 209- 217 ,(1998) , 10.1145/279943.279985
R. Urbanczik, Online learning with ensembles. Physical Review E. ,vol. 62, pp. 1448- 1451 ,(2000) , 10.1103/PHYSREVE.62.1448
Jun-ichi Inoue, Hidetoshi Nishimori, ON-LINE ADATRON LEARNING OF UNLEARNABLE RULES Physical Review E. ,vol. 55, pp. 4544- 4551 ,(1997) , 10.1103/PHYSREVE.55.4544
Seiji Miyoshi, Masato Okada, Analysis of On-Line Learning when a Moving Teacher Goes around a True Teacher Journal of the Physical Society of Japan. ,vol. 75, pp. 024003- 024003 ,(2006) , 10.1143/JPSJ.75.024003
Kazuyuki Hara, Masato Okada, Ensemble Learning of Linear Perceptrons: On-Line Learning Theory Journal of the Physical Society of Japan. ,vol. 74, pp. 2966- 2972 ,(2005) , 10.1143/JPSJ.74.2966