A Deep Unsupervised Feature Learning Spiking Neural Network with Binarized Classification Layers for EMNIST Classification using SpykeFlow

作者: John Chiasson , Vishal Saxena , Ruthvik Vaila

DOI:

关键词:

摘要: End user AI is trained on large server farms with data collected from the users. With ever increasing demand for IOT devices, there a need deep learning approaches that can be implemented (at edge) in an energy efficient manner. In this work we approach using spiking neural networks. The unsupervised technique of spike timing dependent plasticity (STDP) binary activations are used to extract features input data. Gradient descent (backpropagation) only output layer perform training classification. accuracies obtained balanced EMNIST set compare favorably other approaches. effect stochastic gradient (SGD) approximations capabilities our network also explored.

参考文章(49)
Navin Anwani, Bipin Rajendran, NormAD - Normalized Approximate Descent based supervised learning rule for spiking neurons international joint conference on neural network. pp. 1- 8 ,(2015) , 10.1109/IJCNN.2015.7280618
Xinyu Wu, Vishal Saxena, Kehan Zhu, Homogeneous Spiking Neuromorphic System for Real-World Pattern Recognition IEEE Journal on Emerging and Selected Topics in Circuits and Systems. ,vol. 5, pp. 254- 266 ,(2015) , 10.1109/JETCAS.2015.2433552
Xinyu Wu, Vishal Saxena, Kehan Zhu, Sakkarapani Balagopal, A CMOS Spiking Neuron for Brain-Inspired Neural Networks With Resistive Synapses and In Situ Learning IEEE Transactions on Circuits and Systems Ii-express Briefs. ,vol. 62, pp. 1088- 1092 ,(2015) , 10.1109/TCSII.2015.2456372
Ted Carnevale, Neuron simulation environment Scholarpedia. ,vol. 2, pp. 1378- ,(2007) , 10.4249/SCHOLARPEDIA.1378
Jorg Conradt, Raphael Berner, Matthew Cook, Tobi Delbruck, An embedded AER dynamic vision sensor for low-latency pole balancing international conference on computer vision. pp. 780- 785 ,(2009) , 10.1109/ICCVW.2009.5457625
John D. Hunter, Matplotlib: A 2D Graphics Environment Computing in Science and Engineering. ,vol. 9, pp. 90- 95 ,(2007) , 10.1109/MCSE.2007.55
Timothée Masquelier, Rudy Guyonneau, Simon J Thorpe, None, Spike Timing Dependent Plasticity Finds the Start of Repeating Patterns in Continuous Spike Trains PLoS ONE. ,vol. 3, pp. e1377- ,(2008) , 10.1371/JOURNAL.PONE.0001377
Trevor Bekolay, James Bergstra, Eric Hunsberger, Travis DeWolf, Terrence C. Stewart, Daniel Rasmussen, Xuan Choo, Aaron Russell Voelker, Chris Eliasmith, Nengo: a Python tool for building large-scale functional brain models. Frontiers in Neuroinformatics. ,vol. 7, pp. 48- 48 ,(2014) , 10.3389/FNINF.2013.00048
Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, Li Fei-Fei, ImageNet: A large-scale hierarchical image database computer vision and pattern recognition. pp. 248- 255 ,(2009) , 10.1109/CVPR.2009.5206848