Modeling Relation Paths for Representation Learning of Knowledge Bases

作者: Yankai Lin , Zhiyuan Liu , Huanbo Luan , Maosong Sun , Siwei Rao

DOI: 10.18653/V1/D15-1082

关键词:

摘要: Representation learning of knowledge bases aims to embed both entities and relations into a low-dimensional space. Most existing methods only consider direct in representation learning. We argue that multiple-step relation paths also contain rich inference patterns between entities, propose path-based model. This model considers as translations for learning, addresses two key challenges: (1) Since not all are reliable, we design path-constraint resource allocation algorithm measure the reliability paths. (2) represent via semantic composition embeddings. Experimental results on real-world datasets show that, compared with baselines, our achieves significant consistent improvements base completion extraction from text. The source code this paper can be obtained https://github.com/mrlyk423/ relation_extraction.

参考文章(32)
Antoine Bordes, Xavier Glorot, Jason Weston, Yoshua Bengio, A semantic matching energy function for learning with multi-relational data neural information processing systems. ,vol. 94, pp. 233- 259 ,(2014) , 10.1007/S10994-013-5363-6
Matt Gardner, Tom Mitchell, Partha Pratim Talukdar, Bryan Kisiel, Improving Learning and Inference in a Large Knowledge-Base using Latent Syntactic Cues empirical methods in natural language processing. pp. 833- 838 ,(2013)
Mihai Surdeanu, Ramesh Nallapati, Julie Tibshirani, Christopher D. Manning, Multi-instance Multi-label Learning for Relation Extraction empirical methods in natural language processing. pp. 455- 465 ,(2012)
Tomas Mikolov, Martin Karafiát, Sanjeev Khudanpur, Jan Cernocký, Lukás Burget, Recurrent neural network based language model conference of the international speech communication association. pp. 1045- 1048 ,(2010)
Volker Tresp, Hans-peter Kriegel, Maximilian Nickel, A Three-Way Model for Collective Learning on Multi-Relational Data international conference on machine learning. pp. 809- 816 ,(2011)
Yoshua Bengio, Xavier Glorot, Jason Weston, Antoine Bordes, Joint Learning of Words and Meaning Representations for Open-Text Semantic Parsing international conference on artificial intelligence and statistics. ,vol. 22, pp. 127- 135 ,(2012)
Sebastian Riedel, Limin Yao, Andrew McCallum, Modeling relations and their mentions without labeled text european conference on machine learning. pp. 148- 163 ,(2010) , 10.1007/978-3-642-15939-8_10
Ni Lao, Tom Mitchell, William Cohen, None, Random Walk Inference and Learning in A Large Scale Knowledge Base empirical methods in natural language processing. pp. 529- 539 ,(2011)
Nicolas Usunier, Jason Weston, Antoine Bordes, Oksana Yakhnenko, Connecting Language and Knowledge Bases with Embedding Models for Relation Extraction empirical methods in natural language processing. pp. 1366- 1371 ,(2013)
Tao Zhou, Jie Ren, Matúš Medo, Yi-Cheng Zhang, Bipartite network projection and personal recommendation. Physical Review E. ,vol. 76, pp. 046115- ,(2007) , 10.1103/PHYSREVE.76.046115