PairNorm

Official pytorch source code for PairNorm paper (ICLR 2020)
This code requires pytorch_geometric>=1.3.2

usage

For SGC, we use original PairNorm. Notice norm_scale is data-dependent. One can choose it from {0.1, 1, 10, 50}.

python main.py --data cora --model SGC --nlayer 40 --missing_rate 100 --norm_mode PN --norm_scale 10

For GCN or GAT, we use PairNorm-SI or SCS.

python main.py --data cora --model DeepGCN --nlayer 10 --missing_rate 100 --norm_mode PN-SI --residual 0
python main.py --data cora --model DeepGAT --nlayer 10 --missing_rate 100 --norm_mode PN-SCS --residual 0

update: normalization and PN

we have found that PN works bad with symmetric normalized adjacency matrix, originally the experiments align with the paper used row-normalized adjacency matrix. What's more, we also found a small bug in the old experiments with using PN for GCN and GAT. The current version PN should works good for GCN and GAT also (haven't fully tested). Please start from using PN before testing PN-SI and PN-SCS.

For GCN or GAT, now using PN to start.

python main.py --data cora --model DeepGCN --nlayer 10 --missing_rate 100 --norm_mode PN --residual 0
python main.py --data cora --model DeepGAT --nlayer 10 --missing_rate 100 --norm_mode PN --residual 0

cite

If you use our code, please cite

@inproceedings{
zhao2020pairnorm,
title={PairNorm: Tackling Oversmoothing in {\{}GNN{\}}s},
author={Lingxiao Zhao and Leman Akoglu},
booktitle={International Conference on Learning Representations},
year={2020},
url={https://openreview.net/forum?id=rkecl1rtwB}
}

Source code for PairNorm (ICLR 2020)

Related tags

Overview

PairNorm

usage

update: normalization and PN

cite

Owner

Implementation EfficientDet: Scalable and Efficient Object Detection in PyTorch

Implementation of Feedback Transformer in Pytorch

VR-Caps: A Virtual Environment for Active Capsule Endoscopy

Implementation of trRosetta and trDesign for Pytorch, made into a convenient package

PRIME: A Few Primitives Can Boost Robustness to Common Corruptions

This program automatically runs Python code copied in clipboard

A simple pygame dino game which can also be trained and played by a NEAT KI

Pytorch implementation of our method for regularizing nerual radiance fields for few-shot neural volume rendering.

RP-GAN: Stable GAN Training with Random Projections

From a body shape, infer the anatomic skeleton.

DeepHawkeye is a library to detect unusual patterns in images using features from pretrained neural networks

MMGeneration is a powerful toolkit for generative models, based on PyTorch and MMCV.

Code for Talk-to-Edit (ICCV2021). Paper: Talk-to-Edit: Fine-Grained Facial Editing via Dialog.

Malmo Collaborative AI Challenge - Team Pig Catcher

Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Data

计算机视觉中用到的注意力模块和其他即插即用模块PyTorch Implementation Collection of Attention Module and Plug&Play Module

Image Segmentation Animation using Quadtree concepts.

A denoising autoencoder + adversarial losses and attention mechanisms for face swapping.

PyTorch implementation of federated learning framework based on the acceleration of global momentum

Jiminy Cricket Environment (NeurIPS 2021)