Neural network unit with output buffer feedback and masking capability with processing unit groups that operate as recurrent neural network lstm cells

作者: Terry Parks , G. Glenn Henry , Kyle T. O'Brien

DOI:

关键词:

摘要: An output buffer holds N words arranged as N/J mutually exclusive word groups (OBWG) of J each. processing units (PU) are PU each having an associated OBWG. Each has accumulator, arithmetic unit, and first second multiplexed registers at least J+1 inputs. A input receives a memory operand the other inputs receive accumulator provides its to respective unit performs operation on register outputs generate result for accumulation into accumulator. mask controls which words, if any, retain their current value or updated with output. group operates recurrent neural network LSTM cell.

参考文章(48)
Vincent Vanhoucke, Andrew Senior, Mark Z. Mao, Improving the speed of neural networks on CPUs hgpu.org. ,(2011)
Michael I Jordan, None, Serial Order: A Parallel Distributed Processing Approach Advances in psychology. ,vol. 121, pp. 471- 495 ,(1997) , 10.1016/S0166-4115(97)80111-2
Premysl Vaclavik, Alois Hahn, Christian Tiringer, Heinz Gerald Krottendorfer, Digital signal processing device ,(2004)
Colin Christopher Sharp, David Rigel Garcia Garcia, Chihong Zhang, Alexei Vladimirovich Bourd, Inter-processor communication techniques in a multiple-processor computing platform ,(2011)
Kumar Chellapilla, Sidd Puri, Patrice Simard, High Performance Convolutional Neural Networks for Document Processing international conference on frontiers in handwriting recognition. ,(2006)
Dongsun Kim, Hyunsik Kim, Hongsik Kim, Gunhee Han, Duckjin Chung, A SIMD Neural Network Processor for Image Processing Advances in Neural Networks – ISNN 2005. ,vol. 3497, pp. 665- 672 ,(2005) , 10.1007/11427445_108
Tara N. Sainath, Oriol Vinyals, Andrew Senior, Hasim Sak, Convolutional, Long Short-Term Memory, fully connected Deep Neural Networks international conference on acoustics, speech, and signal processing. pp. 4580- 4584 ,(2015) , 10.1109/ICASSP.2015.7178838
Klaus Greff, Rupesh K. Srivastava, Jan Koutnik, Bas R. Steunebrink, Jurgen Schmidhuber, LSTM: A Search Space Odyssey IEEE Transactions on Neural Networks. ,vol. 28, pp. 2222- 2232 ,(2017) , 10.1109/TNNLS.2016.2582924
James C. Abel, Derin C. Walters, Jonathan J. Tyler, SIMD integer multiply high with round and shift ,(2003)