Phased LSTM: Accelerating Recurrent Network Training for Long or Event-based Sequences

作者: Michael Pfeiffer , Daniel Neil , Shih-Chii Liu

DOI: 10.5167/UZH-149394

关键词:

摘要: Recurrent Neural Networks (RNNs) have become the state-of-the-art choice for extracting patterns from temporal sequences. Current RNN models are ill suited to process irregularly …

参考文章(27)
Tomas Mikolov, Martin Karafiát, Sanjeev Khudanpur, Jan Cernocký, Lukás Burget, Recurrent neural network based language model conference of the international speech communication association. pp. 1045- 1048 ,(2010)
Eric Battenberg, Brian McFee, Daniel Maturana, Søren Kaae Sønderby, Jan Schlüter, Colin Raffel, Sander Dieleman, Jonas Degrave, CongLiu, Jeffrey De Fauw, peterderivaz, Michael Heilman, Eben Olson, Jack Kelly, diogo, Hendrik Weideman, Jon, Daniel Nouri, instagibbs, Britefury, takacsg, Martin Thoma, Kashif Rasul, Lasagne: First release. ,(2015) , 10.5281/ZENODO.27878
Kelvin Xu, Jimmy Ba, Ryan Kiros, Kyunghyun Cho, Aaron Courville, Ruslan Salakhudinov, Rich Zemel, Yoshua Bengio, None, Show, Attend and Tell: Neural Image Caption Generation with Visual Attention international conference on machine learning. ,vol. 3, pp. 2048- 2057 ,(2015)
Diederik P. Kingma, Jimmy Ba, Adam: A Method for Stochastic Optimization arXiv: Learning. ,(2014)
Kaiming He, Xiangyu Zhang, Shaoqing Ren, Jian Sun, Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification international conference on computer vision. pp. 1026- 1034 ,(2015) , 10.1109/ICCV.2015.123
Alex Graves, Generating Sequences With Recurrent Neural Networks arXiv: Neural and Evolutionary Computing. ,(2013)
Awni Y. Hannun, Andrew Y. Ng, Sanjeev Satheesh, Jared Casper, Adam Coates, Shubho Sengupta, Greg Diamos, Erich Elsen, Ryan Prenger, Bryan Catanzaro, Carl Case, Deep Speech: Scaling up end-to-end speech recognition arXiv: Computation and Language. ,(2014)
Bernhard Nessler, Michael Pfeiffer, Lars Buesing, Wolfgang Maass, Bayesian Computation Emerges in Generic Cortical Microcircuits through Spike-Timing-Dependent Plasticity PLOS Computational Biology. ,vol. 9, ,(2013) , 10.1371/JOURNAL.PCBI.1003037
Peter O'Connor, Daniel Neil, Shih-Chii Liu, Tobi Delbruck, Michael Pfeiffer, Real-time classification and sensor fusion with a spiking deep belief network Frontiers in Neuroscience. ,vol. 7, pp. 178- 178 ,(2013) , 10.3389/FNINS.2013.00178
Martin Cooke, Jon Barker, Stuart Cunningham, Xu Shao, An audio-visual corpus for speech perception and automatic speech recognition Journal of the Acoustical Society of America. ,vol. 120, pp. 2421- 2424 ,(2006) , 10.1121/1.2229005