Tree Structure-Aware Graph Representation Learning via Integrated Hierarchical Aggregation and Relational Metric Learning

作者: Yanjie Fu , Yi Du , Pengyang Wang , Ziyue Qiao , Pengfei Wang

DOI:

关键词: Theoretical computer scienceComputer scienceGraph neural networksFeature vectorGraphTree structureGraph (abstract data type)Embedding

摘要: While Graph Neural Network (GNN) has shown superiority in learning node representations of homogeneous graphs, leveraging GNN on heterogeneous graphs remains a challenging problem. The dominating reason is that learns by aggregating neighbors' information regardless types. Some work proposed to alleviate such issue exploiting relations or meta-path sample neighbors with distinct categories, then use attention mechanism learn different importance for categories. However, one limitation the learned types nodes should own feature spaces, while all above still project into space. Moreover, after exploring massive we identify fact multiple same type always connect another type, which reveals many-to-one schema, a.k.a. hierarchical tree structure. But cannot preserve structure, since exact multi-hop path correlation from target would be erased through aggregation. Therefore, overcome limitations literature, propose T-GNN, structure-aware graph neural network model representation learning. Specifically, T-GNN consists two modules: (1) integrated aggregation module and (2) relational metric module. aims structure combining Gated Recurrent Unit integrate sequential neighborhood representations. heterogeneity embedding each type-specific space distribution based similarity metrics.

参考文章(42)
Xin Rong, word2vec Parameter Learning Explained arXiv: Computation and Language. ,(2014)
Qiaozhu Mei, Meng Qu, Mingzhe Wang, Jian Tang, Ming Zhang, Jun Yan, LINE: Large-scale Information Network Embedding the web conference. pp. 1067- 1077 ,(2015) , 10.1145/2736277.2741093
Tomas Mikolov, Quoc Le, Distributed Representations of Sentences and Documents international conference on machine learning. ,vol. 4, pp. 1188- 1196 ,(2014)
Ilya Sutskever, Tomas Mikolov, Greg S Corrado, Kai Chen, Jeff Dean, Distributed Representations of Words and Phrases and their Compositionality neural information processing systems. ,vol. 26, pp. 3111- 3119 ,(2013)
Daniel Tarlow, Marc Brockschmidt, Yujia Li, Richard Zemel, Gated Graph Sequence Neural Networks arXiv: Learning. ,(2016)
Daixin Wang, Peng Cui, Wenwu Zhu, Structural Deep Network Embedding knowledge discovery and data mining. pp. 1225- 1234 ,(2016) , 10.1145/2939672.2939753
Wei Lu, Qiongkai Xu, Shaosheng Cao, Deep neural networks for learning graph representations national conference on artificial intelligence. pp. 1145- 1152 ,(2016)
Max Welling, Thomas N. Kipf, Semi-Supervised Classification with Graph Convolutional Networks arXiv: Learning. ,(2016)
Youngjoo Seo, Michaël Defferrard, Pierre Vandergheynst, Xavier Bresson, Structured Sequence Modeling with Graph Convolutional Recurrent Networks Neural Information Processing. pp. 362- 373 ,(2018) , 10.1007/978-3-030-04167-0_33
Nikos Mamoulis, Zhipeng Huang, Heterogeneous Information Network Embedding for Meta Path based Proximity. arXiv: Artificial Intelligence. ,(2017)