A Deep Bidirectional Highway Long Short-Term Memory Network Approach to Chinese Semantic Role Labeling

作者: Qi Xia , Chung-Hsing Yeh , Xiang-Yu Chen , None

DOI: 10.1109/IJCNN.2019.8852323

关键词: Artificial neural networkFeature (linguistics)Computer sciencePart of speechArtificial intelligenceChinese languageConditional random fieldNatural language processingSemantic role labeling

摘要: Existing approaches to Chinese semantic role labeling (SRL) mainly adopt deep long short-term memory (LSTM) neural networks address the long-term dependencies problem. However, LSTM cannot vanishing gradient problem properly. In addition, complexity of language, as a hieroglyphic decreases performance traditional SRL SRL. To these problems, this paper proposes new approach with bidirectional highway network. The proposed is further improved by introducing conditional random fields (CRFs) constraints and part-of-speech (POS) feature since POS tags are classes formal equivalents words in linguistics. experimental results on commonly used Proposition Bank dataset show that outperforms existing approaches. With an easily acquired reliable for practical applications, substantially improves

参考文章(49)
So-Young Park, Young-Sook Hwang, Joon-Ho Lim, Hae-Chang Rim, Semantic Role Labeling using Maximum Entropy Model conference on computational natural language learning. pp. 122- 125 ,(2004)
Martha Palmer, Nianwen Xue, Automatic semantic role labeling for Chinese verbs international joint conference on artificial intelligence. pp. 1160- 1165 ,(2005)
Daniel Jurafsky, Honglin Sun, Shallow Semantc Parsing of Chinese. north american chapter of the association for computational linguistics. pp. 249- 256 ,(2004)
Klaus Greff, Rupesh Kumar Srivastava, Jürgen Schmidhuber, Training very deep networks neural information processing systems. ,vol. 28, pp. 2377- 2385 ,(2015)
Vasin Punyakanok, Wen-tau Yih, Dan Roth, The necessity of syntactic parsing for semantic role labeling international joint conference on artificial intelligence. pp. 1117- 1123 ,(2005)
Andrew McCallum, Dayne Freitag, Fernando C. N. Pereira, Maximum Entropy Markov Models for Information Extraction and Segmentation international conference on machine learning. pp. 591- 598 ,(2000)
Zhiheng Huang, Kai Yu, Wei Xu, Bidirectional LSTM-CRF Models for Sequence Tagging arXiv: Computation and Language. ,(2015)
Erick R Fonseca, Joao Luis G Rosa, None, A two-step convolutional neural network approach for semantic role labeling international joint conference on neural network. pp. 1- 7 ,(2013) , 10.1109/IJCNN.2013.6707118
Alessandro Moschitti, Daniele Pighin, Roberto Basili, Tree kernels for semantic role labeling Computational Linguistics. ,vol. 34, pp. 193- 224 ,(2008) , 10.1162/COLI.2008.34.2.193
Vasin Punyakanok, Dan Roth, Wen-tau Yih, The importance of syntactic parsing and inference in semantic role labeling Computational Linguistics. ,vol. 34, pp. 257- 287 ,(2008) , 10.1162/COLI.2008.34.2.257