Beyond Homophily in Graph Neural Networks: Current Limitations and Effective Designs.

作者: Danai Koutra , Leman Akoglu , Mark Heimann , Yujun Yan , Lingxiao Zhao

DOI:

关键词:

摘要: We investigate the representation power of graph neural networks in semi-supervised node classification task under heterophily or low homophily, i.e., where connected nodes may have different class labels and dissimilar features. Many popular GNNs fail to generalize this setting, are even outperformed by models that ignore structure (e.g., multilayer perceptrons). Motivated limitation, we identify a set key designs -- ego- neighbor-embedding separation, higher-order neighborhoods, combination intermediate representations boost learning from heterophily. combine them into network, H2GCN, which use as base method empirically evaluate effectiveness identified designs. Going beyond traditional benchmarks with strong our empirical analysis shows increase accuracy up 40% 27% over without on synthetic real heterophily, respectively, yield competitive performance homophily.

参考文章(42)
Wolfgang Gatterbauer, Semi-Supervised Learning with Heterophily. arXiv: Learning. ,(2014)
John Lafferty, Xiaojin Zhu, Ronald Rosenfeld, Semi-supervised learning with graphs Carnegie Mellon University. ,(2005)
Danai Koutra, Tai-You Ke, U. Kang, Duen Horng Chau, Hsing-Kuo Kenneth Pao, Christos Faloutsos, Unifying guilt-by-association approaches: theorems and fast algorithms european conference on machine learning. pp. 245- 260 ,(2011) , 10.1007/978-3-642-23783-6_16
Sanghamitra Bandyopadhyay, Ujjwal Maulik, Lawrence B Holder, Diane J Cook, Lise Getoor, Link-based classification international conference on machine learning. pp. 496- 503 ,(2003) , 10.1007/1-84628-284-5_7
Albert-László Barabási, Réka Albert, Emergence of Scaling in Random Networks Science. ,vol. 286, pp. 509- 512 ,(1999) , 10.1126/SCIENCE.286.5439.509
Jonathan S. Yedidia, Yair Weiss, William T. Freeman, Understanding belief propagation and its generalizations Exploring artificial intelligence in the new millennium. pp. 239- 269 ,(2003)
Pierre Vandergheynst, Pascal Frossard, Sunil K. Narang, Antonio Ortega, David I Shuman, The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains IEEE Signal Processing Magazine. ,vol. 30, pp. 83- 98 ,(2013) , 10.1109/MSP.2012.2235192
Jie Tang, Jimeng Sun, Chi Wang, Zi Yang, Social influence analysis in large-scale networks Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining - KDD '09. pp. 807- 816 ,(2009) , 10.1145/1557019.1557108
David Jensen, Jennifer Neville, Iterative Classification in Relational Data ,(2000)