Pytorch Implementation of Spiking Neural Networks Calibration, ICML 2021

Last update: Dec 27, 2022

Related tags

Overview

SNN_Calibration

Pytorch Implementation of Spiking Neural Networks Calibration, ICML 2021

Feature Comparison of SNN calibration:

Features	SNN Direct Training	ANN-SNN Conversion	SNN Calibration
Accuract (T<100)	High	Low	High
Scalability to ImageNet	Tiny	Large	Large
Training Speed	Slow	Fast	Fast
# Required Data	Full-set (1.2M For ImageNet)	~1000	~1000
Inference Speed	Fast	Slow	Fast

Requirements

Pytorch 1.8

For ImageNet experiments, please be sure that you can initialize distributed environments

For CIFAR experiments, one GPU would suffice.

Pre-training ANN on CIFAR10&100

Train an ANN model with main_train.py

python CIFAR/main_train.py --dataset CIFAR10 --arch VGG16 --dpath PATH/TO/DATA --usebn

Pre-trained results:

Dataset	Model	Random Seed	Accuracy
CIFAR10	VGG16	1000	95.76
CIFAR10	ResNet-20	1000	95.68
CIFAR100	VGG16	1000	77.98
CIFAR100	ResNet-20	1000	76.52

SNN Calibration on CIFAR10&100

Calibrate an SNN with main_calibration.py.

python CIFAR/main_calibration.py --dataset CIFAR10 --arch VGG16 --T 16 --usebn --calib advanced --dpath PATH/TO/DATA

--T is the time step, --calib is the calibration method, please use none, light, advanced for experiments.

The calibration will run for 5 times, and return the mean accuracy as well as the standard deviation.

Example results:

Architecture	Datset	T	Random Seed	Calibration	Mean Acc	Std.
VGG16	CIFAR10	16	1000	None	64.52	4.12
VGG16	CIFAR10	16	1000	Light	93.30	0.08
VGG16	CIFAR10	16	1000	Advanced	93.65	0.25
ResNet-20	CIFAR10	16	1000	None	67.88	3.63
ResNet-20	CIFAR10	16	1000	Light	93.89	0.20
ResNet-20	CIFAR10	16	1000	Advanced	94.33	0.12
VGG16	CIFAR100	16	1000	None	2.69	0.76
VGG16	CIFAR100	16	1000	Light	65.26	0.99
VGG16	CIFAR100	16	1000	Advanced	70.91	0.65
ResNet-20	CIFAR100	16	1000	None	39.27	2.85
ResNet-20	CIFAR100	16	1000	Light	73.89	0.15
ResNet-20	CIFAR100	16	1000	Advanced	74.48	0.16

Pre-training ANN on ImageNet

To be updaed

Pytorch Implementation of Spiking Neural Networks Calibration, ICML 2021

Related tags

Overview

SNN_Calibration

Requirements

Pre-training ANN on CIFAR10&100

SNN Calibration on CIFAR10&100

Pre-training ANN on ImageNet

Owner

Yuhang Li

Dyalog-apl-docset - Dyalog APL Dash Docset Generator

Out of Distribution Detection on Natural Adversarial Examples

In this project we investigate the performance of the SetCon model on realistic video footage. Therefore, we implemented the model in PyTorch and tested the model on two example videos.

Boosted CVaR Classification (NeurIPS 2021)

Deep Learning Based Fasion Recommendation System for Ecommerce

A Python package to process & model ChEMBL data.

Lowest memory consumption and second shortest runtime in NTIRE 2022 challenge on Efficient Super-Resolution

Let's create a tool to convert Thailand budget from PDF to CSV.

Codes for the AAAI'22 paper "TransZero: Attribute-guided Transformer for Zero-Shot Learning"

Labelbox is the fastest way to annotate data to build and ship artificial intelligence applications

This is an official implementation for "PlaneRecNet".

The Balloon Learning Environment - flying stratospheric balloons with deep reinforcement learning.

Official implementation of "Motif-based Graph Self-Supervised Learning forMolecular Property Prediction"

Implementation and replication of ProGen, Language Modeling for Protein Generation, in Jax

A-ESRGAN aims to provide better super-resolution images by using multi-scale attention U-net discriminators.

A Multi-modal Perception Tracker (MPT) for speaker tracking using both audio and visual modalities

CUP-DNN is a deep neural network model used to predict tissues of origin for cancers of unknown of primary.

Open-source codebase for EfficientZero, from "Mastering Atari Games with Limited Data" at NeurIPS 2021.

Submodular Subset Selection for Active Domain Adaptation (ICCV 2021)

[CVPR'21] Projecting Your View Attentively: Monocular Road Scene Layout Estimation via Cross-view Transformation