Learning incremental syntactic structures with recursive neural networks

作者: F. Costa , P. Frasconi , V. Lombardo , G. Soda

DOI: 10.1109/KES.2000.884088

关键词: Natural language processingArtificial intelligenceRecurrent neural networkTreebankParsingComputer scienceNatural languageParsing expression grammarDeep learningArtificial neural networkSyntaxRule-based machine translation

摘要: We develop novel algorithmic ideas for building a natural language parser grounded upon the hypothesis of incrementality, which is widely supported by experimental data as model human parsing. Our proposal relies on machine learning technique predicting correctness partial syntactic structures that are built during parsing process. A recursive neural network architecture employed computing predictions after training phase examples drawn from corpus parsed sentences, Penn Treebank. results indicate viability approach and lay out premises generation algorithms processing more closely These may prove very useful in development efficient parsers have an immediate application construction semiautomatic annotation tools.

参考文章(12)
Stuart Shieber, Mark Steedman, Edward P. Stabler, Dominique Sportiche, Mark Johnson, Tim Stowell, Anoop Mahajan, Terry Langendoen, Ed Keenan, Ted Gibson, The nite connectivity of linguistic structure ,(1999)
Mitch Marcus, Beatrice Santorini, Mary Ann Marcinkiewicz, None, Building a large annotated corpus of English: the penn treebank Computational Linguistics. ,vol. 19, pp. 313- 330 ,(1993) , 10.21236/ADA273556
Jordan B. Pollack, Recursive distributed representations Artificial Intelligence. ,vol. 46, pp. 77- 105 ,(1990) , 10.1016/0004-3702(90)90005-K
WILLIAM MARSLEN-WILSON, Linguistic Structure and Speech Shadowing at Very Short Latencies Nature. ,vol. 244, pp. 522- 523 ,(1973) , 10.1038/244522A0
Jerry R. Hobbs, John Bear, Two principles of parse preference international conference on computational linguistics. ,vol. 3, pp. 162- 167 ,(1990) , 10.3115/991146.991175
Lyn Frazier, Janet Dean Fodor, The Sausage Machine: A New Two-Stage Parsing Model. Cognition. ,vol. 6, pp. 291- 325 ,(1978) , 10.1016/0010-0277(78)90002-1
David Milward, Incremental interpretation of Categorial Grammar Proceedings of the seventh conference on European chapter of the Association for Computational Linguistics -. pp. 119- 126 ,(1995) , 10.3115/976973.976991
C. Goller, A. Kuchler, Learning task-dependent distributed representations by backpropagation through structure Proceedings of International Conference on Neural Networks (ICNN'96). ,vol. 1, pp. 347- 352 ,(1996) , 10.1109/ICNN.1996.548916
Michael John Collins, A new statistical parser based on bigram lexical dependencies Proceedings of the 34th annual meeting on Association for Computational Linguistics -. pp. 184- 191 ,(1996) , 10.3115/981863.981888