Joint Learning of Words and Meaning Representations for Open-Text Semantic Parsing

作者: Yoshua Bengio , Xavier Glorot , Jason Weston , Antoine Bordes

DOI:

关键词:

摘要: Open-text semantic parsers are designed to interpret any statement in natural language by inferring a corresponding meaning representation (MR – formal of its sense). Unfortunately, large scale systems cannot be easily machine-learned due lack directly supervised data. We propose method that learns assign MRs wide range text (using dictionary more than 70,000 words mapped 40,000 entities) thanks training scheme combines learning from knowledge bases (e.g. WordNet) with raw text. The model jointly representations words, entities and via multi-task process operating on these diverse sources Hence, the system ends up providing methods for acquisition wordsense disambiguation within context parsing single elegant framework. Experiments various tasks indicate promise approach.

参考文章(32)
Kingsbury Paul, Palmer Martha, None, From treebank to propbank language resources and evaluation. ,(2002)
Alessandro Moschitti, Ana-Maria Giuglea, Shallow Semantic Parsing Based on FrameNet, VerbNet and PropBank european conference on artificial intelligence. pp. 563- 567 ,(2006)
Alessandro Moschitti, Bonaventura Coppola, A General Purpose FrameNet-based Shallow Semantic Parser. language resources and evaluation. ,(2010)
Ilya Sutskever, Geoffrey E. Hinton, James Martens, Generating Text with Recurrent Neural Networks international conference on machine learning. pp. 1017- 1024 ,(2011)
Richard Socher, Andrew Y. Ng, Cliff C. Lin, Chris Manning, Parsing Natural Scenes and Natural Language with Recursive Neural Networks international conference on machine learning. pp. 129- 136 ,(2011)
J Altun, G Bakir, O Bousquet, S Chopra, C Cortes, Daume III, O Dekel, Z Ghahramani, R Hadsell, T Hofmann, F Huang, Y LeCun, T Mann, D Marcu, D McAllester, M Mohri, W Stafford Noble, F Pérez-Cruz, M Pontil, M Ranzato, J Rousu, C Saunders, B Schölkopf, MW Seeger, S Shalev-Shwartz, J Shawe-Taylor, Y Singer, AJ Smola, S Szedmak, B Taskar, I Tsochantaridis, SBN Vishwanathan, J Weston, Predicting Structured Data MIT Press. ,(2007)
Eneko Agirre, Eduard Hovy, David Martínez, Olatz Ansa, Enriching very large ontologies using the WWW OL'00 Proceedings of the First International Conference on Ontology Learning - Volume 31. pp. 25- 30 ,(2000)
Yoshua Bengio, Neural net language models Scholarpedia. ,vol. 3, pp. 3881- ,(2008) , 10.4249/SCHOLARPEDIA.3881
Herbert Robbins, Sutton Monro, A Stochastic Approximation Method Annals of Mathematical Statistics. ,vol. 22, pp. 400- 407 ,(1951) , 10.1214/AOMS/1177729586