Simple and Deep Graph Convolutional Networks
Ming Chen, Zhewei Wei, Zengfeng Huang, Bolin Ding, Yaliang Li
Code Available — Be the first to reproduce this paper.
ReproduceCode
- github.com/chennnM/GCNIIOfficialIn paperpytorch★ 358
- github.com/zhanglab-aim/cancer-netpytorch★ 5
- github.com/tyxxzjpdez/GCNII-DropGroupspytorch★ 2
- github.com/chennnM/GCNII/tree/master/PyG/ogbn-arxivpytorch★ 0
Abstract
Graph convolutional networks (GCNs) are a powerful deep learning approach for graph-structured data. Recently, GCNs and subsequent variants have shown superior performance in various application areas on real-world datasets. Despite their success, most of the current GCN models are shallow, due to the over-smoothing problem. In this paper, we study the problem of designing and analyzing deep graph convolutional networks. We propose the GCNII, an extension of the vanilla GCN model with two simple yet effective techniques: Initial residual and Identity mapping. We provide theoretical and empirical evidence that the two techniques effectively relieves the problem of over-smoothing. Our experiments show that the deep GCNII model outperforms the state-of-the-art methods on various semi- and full-supervised tasks. Code is available at https://github.com/chennnM/GCNII .
Tasks
Benchmark Results
| Dataset | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| Citeseer Full-supervised | GCNII* | Accuracy | 77.13 | — | Unverified |
| CiteSeer with Public Split: fixed 20 nodes per class | GCNII | Accuracy | 73.4 | — | Unverified |
| Cora Full-supervised | GCNII | Accuracy | 88.49 | — | Unverified |
| Cora with Public Split: fixed 20 nodes per class | GCNII | Accuracy | 85.5 | — | Unverified |
| PPI | GCNII* | F1 | 99.56 | — | Unverified |
| Pubmed Full-supervised | GCNII* | Accuracy | 90.3 | — | Unverified |
| PubMed with Public Split: fixed 20 nodes per class | GCNII | Accuracy | 80.2 | — | Unverified |