PairNorm

Official pytorch source code for PairNorm paper (ICLR 2020)
This code requires pytorch_geometric>=1.3.2

usage

For SGC, we use original PairNorm. Notice norm_scale is data-dependent. One can choose it from {0.1, 1, 10, 50}.

python main.py --data cora --model SGC --nlayer 40 --missing_rate 100 --norm_mode PN --norm_scale 10

For GCN or GAT, we use PairNorm-SI or SCS.

python main.py --data cora --model DeepGCN --nlayer 10 --missing_rate 100 --norm_mode PN-SI --residual 0
python main.py --data cora --model DeepGAT --nlayer 10 --missing_rate 100 --norm_mode PN-SCS --residual 0

update: normalization and PN

we have found that PN works bad with symmetric normalized adjacency matrix, originally the experiments align with the paper used row-normalized adjacency matrix. What's more, we also found a small bug in the old experiments with using PN for GCN and GAT. The current version PN should works good for GCN and GAT also (haven't fully tested). Please start from using PN before testing PN-SI and PN-SCS.

For GCN or GAT, now using PN to start.

python main.py --data cora --model DeepGCN --nlayer 10 --missing_rate 100 --norm_mode PN --residual 0
python main.py --data cora --model DeepGAT --nlayer 10 --missing_rate 100 --norm_mode PN --residual 0

cite

If you use our code, please cite

@inproceedings{
zhao2020pairnorm,
title={PairNorm: Tackling Oversmoothing in {\{}GNN{\}}s},
author={Lingxiao Zhao and Leman Akoglu},
booktitle={International Conference on Learning Representations},
year={2020},
url={https://openreview.net/forum?id=rkecl1rtwB}
}

Source code for PairNorm (ICLR 2020)

Related tags

Overview

PairNorm

usage

update: normalization and PN

cite

Owner

CrossMLP - The repository offers the official implementation of our BMVC 2021 paper (oral) in PyTorch.

An efficient implementation of GPNN

Traductor de lengua de señas al español basado en Python con Opencv y MedaiPipe

Pytorch implementation AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networks

[ICCV2021] Safety-aware Motion Prediction with Unseen Vehicles for Autonomous Driving

DCGAN-tensorflow - A tensorflow implementation of Deep Convolutional Generative Adversarial Networks

Code for ACL 21: Generating Query Focused Summaries from Query-Free Resources

A multi-scale unsupervised learning for deformable image registration

Underwater industrial application yolov5m6

Zero-Shot Text-to-Image Generation VQGAN+CLIP Dockerized

Benchmarks for the Optimal Power Flow Problem

UNION: An Unreferenced Metric for Evaluating Open-ended Story Generation

git《Joint Entity and Relation Extraction with Set Prediction Networks》(2020) GitHub:

GMFlow: Learning Optical Flow via Global Matching

The Empirical Investigation of Representation Learning for Imitation (EIRLI)

Checking fibonacci - Generating the Fibonacci sequence is a classic recursive problem

Numenta Platform for Intelligent Computing is an implementation of Hierarchical Temporal Memory (HTM), a theory of intelligence based strictly on the neuroscience of the neocortex.

Augmenting Physical Models with Deep Networks for Complex Dynamics Forecasting

This is the unofficial code of Deep Dual-resolution Networks for Real-time and Accurate Semantic Segmentation of Road Scenes. which achieve state-of-the-art trade-off between accuracy and speed on cityscapes and camvid, without using inference acceleration and extra data

PyExplainer: A Local Rule-Based Model-Agnostic Technique (Explainable AI)