Recurrent Neural Networks
作者： Uday Kamath , John Liu , James Whitaker , Uday Kamath , John Liu
DOI: 10.1007/978-3-030-14596-5_7
关键词:
摘要: In the previous chapter, CNNs provided a way for neural networks to learn hierarchy of weights, resembling that n-gram classification on text. This approach proved be very effective sentiment analysis, or more broadly text classification. One disadvantages CNNs, however, is their inability model contextual information over long sequences.
springer.com
sci-hub.se 参考文章(34)
Brody Huval, Richard Socher, Andrew Y. Ng, Christopher D. Manning, Semantic Compositionality through Recursive Matrix-Vector Spaces empirical methods in natural language processing. pp. 1201- 1211 ,(2012)
Oriol Vinyals, Alexander Toshev, Samy Bengio, Dumitru Erhan, Show and tell: A neural image caption generator computer vision and pattern recognition. pp. 3156- 3164 ,(2015) , 10.1109/CVPR.2015.7298935
Çaglar Gülçehre, Yoshua Bengio, Yoshua Bengio, Yoshua Bengio, KyungHyun Cho, Junyoung Chung, Empirical evaluation of gated recurrent neural networks on sequence modeling arXiv: Neural and Evolutionary Computing. ,(2014)
Zhiheng Huang, Kai Yu, Wei Xu, Bidirectional LSTM-CRF Models for Sequence Tagging arXiv: Computation and Language. ,(2015)
Sepp Hochreiter, Jürgen Schmidhuber, Long short-term memory Neural Computation. ,vol. 9, pp. 1735- 1780 ,(1997) , 10.1162/NECO.1997.9.8.1735
Yoshua Bengio, Salah El Hihi, Hierarchical Recurrent Neural Networks for Long-Term Dependencies neural information processing systems. ,vol. 8, pp. 493- 499 ,(1995)
C. Goller, A. Kuchler, Learning task-dependent distributed representations by backpropagation through structure Proceedings of International Conference on Neural Networks (ICNN'96). ,vol. 1, pp. 347- 352 ,(1996) , 10.1109/ICNN.1996.548916
Y. Bengio, P. Simard, P. Frasconi, Learning long-term dependencies with gradient descent is difficult IEEE Transactions on Neural Networks. ,vol. 5, pp. 157- 166 ,(1994) , 10.1109/72.279181
Richard Socher, Andrew Ng, Danqi Chen, Christopher D Manning, Reasoning With Neural Tensor Networks for Knowledge Base Completion neural information processing systems. ,vol. 26, pp. 926- 934 ,(2013)
Ilya Sutskever, Quoc V. Le, Oriol Vinyals, Sequence to Sequence Learning with Neural Networks neural information processing systems. ,vol. 27, pp. 3104- 3112 ,(2014)