Knowledge Graph Representation Learning With Multi-Scale Capsule-Based Embedding Model Incorporating Entity Descriptions

作者: Jingwei Cheng , Fu Zhang , Zhi Yang

DOI: 10.1109/ACCESS.2020.3035636

关键词:

摘要: A Knowledge Graph (KG) is a directed graph with nodes as entities and edges relations. KG representation learning (KGRL) aims to embed relations in into continuous low-dimensional vector spaces, so simplify the manipulation while preserving inherent structure of KG. In this paper, we propose embedding framework, namely MCapsEED (Multi-Scale Capsule-based Embedding Model Incorporating Entity Descriptions). employs Transformer combination relation attention mechanism identify relation-specific part an entity description obtain entity. The structured representations are integrated synthetic representation. 3-column matrix each column element triple fed Multi-Scale model produce final head entity, tail relation. Experiments show that achieves better performance than state-of-the-art models for task link prediction on four benchmark datasets. Our code can be found at https://github.com/1780041410/McapsEED .

参考文章(44)
Antoine Bordes, Xavier Glorot, Jason Weston, Yoshua Bengio, A semantic matching energy function for learning with multi-relational data neural information processing systems. ,vol. 94, pp. 233- 259 ,(2014) , 10.1007/S10994-013-5363-6
Volker Tresp, Hans-peter Kriegel, Maximilian Nickel, A Three-Way Model for Collective Learning on Multi-Relational Data international conference on machine learning. pp. 809- 816 ,(2011)
Diederik P. Kingma, Jimmy Ba, Adam: A Method for Stochastic Optimization arXiv: Learning. ,(2014)
Li Deng, Jianfeng Gao, Wen-tau Yih, Xiaodong He, Bishan Yang, Embedding Entities and Relations for Learning and Inference in Knowledge Bases international conference on learning representations. ,(2015)
Christian Szegedy, Sergey Ioffe, Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift international conference on machine learning. ,vol. 1, pp. 448- 456 ,(2015)
Jonathan Tompson, Ross Goroshin, Arjun Jain, Yann LeCun, Christoph Bregler, Efficient object localization using Convolutional Networks computer vision and pattern recognition. pp. 648- 656 ,(2015) , 10.1109/CVPR.2015.7298664
Fabian M. Suchanek, Gjergji Kasneci, Gerhard Weikum, Yago: a core of semantic knowledge the web conference. pp. 697- 706 ,(2007) , 10.1145/1242572.1242667
George A. Miller, WordNet Communications of the ACM. ,vol. 38, pp. 39- 41 ,(1995) , 10.1145/219717.219748
Kurt Bollacker, Colin Evans, Praveen Paritosh, Tim Sturge, Jamie Taylor, Freebase Proceedings of the 2008 ACM SIGMOD international conference on Management of data - SIGMOD '08. pp. 1247- 1250 ,(2008) , 10.1145/1376616.1376746
Richard Socher, Andrew Ng, Danqi Chen, Christopher D Manning, Reasoning With Neural Tensor Networks for Knowledge Base Completion neural information processing systems. ,vol. 26, pp. 926- 934 ,(2013)