A new recursive least squares-based learning algorithm for spiking neurons

作者: Hong Qu , Yi Chen , Malu Zhang , Xiaoling Luo , Yun Zhang

DOI: 10.1016/J.NEUNET.2021.01.016

关键词:

摘要: Spiking neural networks (SNNs) are regarded as effective models for processing spatio-temporal information. However, their inherent complexity of temporal coding makes it an arduous task to put forward supervised learning algorithm, which still puzzles researchers in this area. In paper, we propose a Recursive Least Squares-Based Learning Rule (RLSBLR) SNN generate the desired spike train. During process our method, weight update is driven by cost function defined difference between membrane potential and firing threshold. The amount modification depends not only on impact current error function, but also previous functions evaluated weights. order improve performance, integrate modified synaptic delay proposed RLSBLR. We conduct experiments different settings, such spiking lengths, number inputs, rates, noises parameters, thoroughly investigate performance algorithm. RLSBLR compared with competitive algorithms Perceptron-Based Neuron (PBSNLR) Remote Supervised Method (ReSuMe). Experimental results demonstrate that can achieve higher accuracy, efficiency better robustness against types noise. addition, apply open source database TIDIGITS, show algorithm has good practical application performance.

参考文章(75)
Wulfram Gerstner, Werner M. Kistler, Spiking Neuron Models: Single Neurons, Populations, Plasticity ,(2002)
David E. Rumelhart, Geoffrey E. Hinton, Ronald J. Williams, Learning representations by back-propagating errors Nature. ,vol. 323, pp. 696- 699 ,(1988) , 10.1038/323533A0
EI Knudsen, Supervised learning in the brain The Journal of Neuroscience. ,vol. 14, pp. 3985- 3997 ,(1994) , 10.1523/JNEUROSCI.14-07-03985.1994
Renaud Jolivet, Timothy J., Wulfram Gerstner, The spike response model: a framework to predict neuronal spike trains international conference on artificial neural networks. pp. 846- 853 ,(2003) , 10.1007/3-540-44989-2_101
Navin Anwani, Bipin Rajendran, NormAD - Normalized Approximate Descent based supervised learning rule for spiking neurons international joint conference on neural network. pp. 1- 8 ,(2015) , 10.1109/IJCNN.2015.7280618
Aboozar Taherkhani, Ammar Belatreche, Yuhua Li, Liam P. Maguire, Multi-DL-ReSuMe: Multiple neurons Delay Learning Remote Supervised Method international joint conference on neural network. pp. 1- 7 ,(2015) , 10.1109/IJCNN.2015.7280743
Itzchak Parnas, Hanna Parnas, Control of neurotransmitter release: From Ca2+ to voltage dependent G-protein coupled receptors Pflügers Archiv - European Journal of Physiology. ,vol. 460, pp. 975- 990 ,(2010) , 10.1007/S00424-010-0872-7
Yan Xu, Xiaoqin Zeng, Lixin Han, Jing Yang, A supervised multi-spike learning algorithm based on gradient descent for spiking neural networks Neural Networks. ,vol. 43, pp. 99- 113 ,(2013) , 10.1016/J.NEUNET.2013.02.003