Neighborhood Mixture Model for Knowledge Base Completion

作者: Dat Quoc Nguyen , Kairit Sirts , Lizhen Qu , Mark Johnson

DOI: 10.18653/V1/K16-1005

关键词: Mixture modelRelation (database)Data miningMachine learningRepresentation (mathematics)EmbeddingArtificial intelligenceKnowledge baseBenchmark (computing)Computer science

摘要: Knowledge bases are useful resources for many natural language processing tasks, however, they far from complete. In this paper, we define a novel entity representation as mixture of its neighborhood in the knowledge base and apply technique on TransE-a well-known embedding model completion. Experimental results show that information significantly helps to improve TransE model, leading better performance than obtained by other state-of-the-art models three benchmark datasets triple classification, prediction relation tasks.

参考文章(49)
Matthew D. Zeiler, ADADELTA: An Adaptive Learning Rate Method arXiv: Learning. ,(2012)
Volker Tresp, Hans-peter Kriegel, Maximilian Nickel, A Three-Way Model for Collective Learning on Multi-Relational Data international conference on machine learning. pp. 809- 816 ,(2011)
Alberto Garcia-Duran, Antoine Bordes, Nicolas Usunier, Yves Grandvalet, Combining two and three-way embedding models for link prediction in knowledge bases Journal of Artificial Intelligence Research. ,vol. 55, pp. 715- 742 ,(2016) , 10.1613/JAIR.5013
Andrew Carlson, Justin Betteridge, Bryan Kisiel, Burr Settles, Estevam Hruschka, Tom Mitchell, None, Toward an architecture for never-ending language learning national conference on artificial intelligence. pp. 1306- 1313 ,(2010)
Li Deng, Jianfeng Gao, Wen-tau Yih, Xiaodong He, Bishan Yang, Embedding Entities and Relations for Learning and Inference in Knowledge Bases international conference on learning representations. ,(2015)
Jens Lehmann, Robert Isele, Max Jakob, Anja Jentzsch, Dimitris Kontokostas, Pablo N. Mendes, Sebastian Hellmann, Mohamed Morsey, Patrick van Kleef, Sören Auer, Christian Bizer, DBpedia - A Large-scale, Multilingual Knowledge Base Extracted from Wikipedia Social Work. ,vol. 6, pp. 167- 195 ,(2015) , 10.3233/SW-140134
Kenneth D. Forbus, Chen Liang, Learning plausible inferences from semantic web knowledge by combining analogical generalization with structured logistic regression national conference on artificial intelligence. pp. 551- 557 ,(2015)
Percy Liang, Kelvin Guu, John Miller, Traversing Knowledge Graphs in Vector Space arXiv: Computation and Language. ,(2015)
Fabian M. Suchanek, Gjergji Kasneci, Gerhard Weikum, Yago: a core of semantic knowledge the web conference. pp. 697- 706 ,(2007) , 10.1145/1242572.1242667
Dong C. Liu, Jorge Nocedal, On the limited memory BFGS method for large scale optimization Mathematical Programming. ,vol. 45, pp. 503- 528 ,(1989) , 10.1007/BF01589116