An Analytical Approach to Single Node Delay-Coupled Reservoir Computing

作者: Johannes Schumacher , Hazem Toutounji , Gordon Pipa

DOI: 10.1007/978-3-642-40728-4_4

关键词:

摘要: Reservoir computing has been successfully applied in difficult time series prediction tasks by injecting an input signal into a spatially extended reservoir of nonlinear subunits to perform history-dependent computation. Recently, the network was replaced single node, delay-coupled itself. Instead spatial topology, are arrayed along one delay span system. As result, exists only implicitly differential equation, numerical solving which is costly. We derive here approximate analytical equations for underlying system explicitly. The approximation represents accurately and yields comparable performance benchmark tasks, while reducing computational costs several orders magnitude. This important implications with respect electronic realizations opens up new possibilities optimization theoretical investigation.

参考文章(8)
M. C. Soriano, S. Ortín, D. Brunner, L. Larger, C. R. Mirasso, I. Fischer, L. Pesquera, Optoelectronic reservoir computing: tackling noise-induced performance degradation. Optics Express. ,vol. 21, pp. 12- 20 ,(2013) , 10.1364/OE.21.000012
L. Appeltant, M.C. Soriano, G. Van der Sande, J. Danckaert, S. Massar, J. Dambre, B. Schrauwen, C.R. Mirasso, I. Fischer, Information processing using a single dynamical node as complex system Nature Communications. ,vol. 2, pp. 468- 468 ,(2011) , 10.1038/NCOMMS1476
Andreea Lazar, Gordon Pipa, Jochen Triesch, SORN: a self-organizing recurrent neural network Frontiers in Computational Neuroscience. ,vol. 3, pp. 23- 23 ,(2009) , 10.3389/NEURO.10.023.2009
Hazem Toutounji, Johannes Schumacher, Gordon Pipa, Optimized Temporal Multiplexing for Reservoir Computing with a Single Delay-Coupled Node IEICE Proceeding Series. ,vol. 1, pp. 519- 522 ,(2014) , 10.15248/PROC.1.519
L.F. Shampine, S. Thompson, Solving DDEs in MATLAB Applied Numerical Mathematics. ,vol. 37, pp. 441- 458 ,(2001) , 10.1016/S0168-9274(00)00055-6
Wolfgang Maass, Thomas Natschläger, Henry Markram, Real-time computing without stable states: a new framework for neural computation based on perturbations Neural Computation. ,vol. 14, pp. 2531- 2560 ,(2002) , 10.1162/089976602760407955
Robert A. Legenstein, Lars Buesing, Benjamin Schrauwen, On Computational Power and the Order-Chaos Phase Transition in Reservoir Computing neural information processing systems. ,vol. 21, pp. 1425- 1432 ,(2008)
Alfio Quarteroni, Fausto Saleri, Riccardo Sacco, Numerical Mathematics (Texts in Applied Mathematics) Numerical Mathematics (Texts in Applied Mathematics). ,(2006)