STBP is a way to train SNN with datasets by Backward propagation.

Last update: Dec 09, 2022

Overview

Train SNN with STBP in fp32 and low bit(quantize)

Spiking neural network (SNN), compared with depth neural network (DNN), has faster processing speed, lower energy consumption and more biological interpretability, which is expected to approach Strong AI.

STBP is a way to train SNN with datasets by Backward propagation.Using this Repositories allows you to train SNNS with STBP and quantize SNNS with QAT to deploy to neuromorphological chips like Loihi and Tianjic.

Usage

Download via GitHub:

git clone https://github.com/ZLkanyo009/STBP-train-and-compression.git

example to define SNN_layers like ANN_layers

Convert layer to spatiotemporal layer:

conv = nn.Conv2d(...)
conv_s = tdLayer(conv)

Define LIF activation function just like Relu:

spike = LIFSpike()

In the forward function, replace the activation function of each layer with LIF activation function, and replace the calls such as conv() with conv_ s(), then SNN_layers definition is completed.Finally, we use Frequency Coding to decode SNN's output like out = torch.sum(x, dim=2) / steps

def forward(self, x):
    x = self.conv1_s(x)
    x = self.spike(x)
    x = self.pool1_s(x)
    x = self.spike(x)
    x = x.view(x.shape[0], -1, x.shape[4])
    x = self.fc1_s(x)
    x = self.spike(x)
    out = torch.sum(x, dim=2) / steps
    return out

If BN layer is required:

bn = nn.BatchNorm2d(...)
bn = tdBatchNorm(...)
conv_s = tdLayer(conv, bn)

Training Fp32 Model

# Start training fp32 model with: 
# model_name can be ResNet18, CifarNet, ...
python main.py ResNet18 --dataset CIFAR10

# training with DDP:
python -m torch.distributed.launch main.py ResNet18 --local_rank 0 --dataset CIFAR10 --p DDP

# You can manually config the training with: 
python main.py ResNet18 --resume --lr 0.01

Training Quantize Model

# Start training quantize model with: 
# model_name can be ResNet18, CifarNet, ...
python main.py ResNet18 --dataset CIFAR10 -q

# training with DDP:
python -m torch.distributed.launch main.py ResNet18 --local_rank 0 --dataset CIFAR10 -q --p DDP

# You can manually config the training with: 
python main.py ResNet18 -q --resume --bit 4 --lr 0.01

Accuracy

Model	Acc.(fp32)	Acc.(8 bit quantize)
MNISTNet	97.96%	97.57%
ResNet18	84.40%	84.23%

STBP is a way to train SNN with datasets by Backward propagation.

Related tags

Overview

Train SNN with STBP in fp32 and low bit(quantize)

Usage

Download via GitHub:

example to define SNN_layers like ANN_layers

Training Fp32 Model

Training Quantize Model

Accuracy

About STBP

Owner

Ling Zhang

Element selection for functional materials discovery by integrated machine learning of atomic contributions to properties

Facebook AI Research Sequence-to-Sequence Toolkit written in Python.

Official repository for the paper "Instance-Conditioned GAN"

Unofficial TensorFlow implementation of the Keyword Spotting Transformer model

Official PyTorch Implementation for "Recurrent Video Deblurring with Blur-Invariant Motion Estimation and Pixel Volumes"

Spatiotemporal resampling methods for mlr3

Official Implementation of DE-DETR and DELA-DETR in "Towards Data-Efficient Detection Transformers"

Official Repository for Machine Learning class - Physics Without Frontiers 2021

EPSANet：An Efficient Pyramid Split Attention Block on Convolutional Neural Network

This application explain how we can easily integrate Deepface framework with Python Django application

Setup freqtrade/freqUI on Heroku

VGG16 model-based classification project about brain tumor detection.

Orange Chicken: Data-driven Model Generalizability in Crosslinguistic Low-resource Morphological Segmentation

A PyTorch implementation of the continual learning experiments with deep neural networks

Codes for the AAAI'22 paper "TransZero: Attribute-guided Transformer for Zero-Shot Learning"

Jiminy Cricket Environment (NeurIPS 2021)

Kindle is an easy model build package for PyTorch.

An easy-to-use app to visualise attentions of various VQA models.

TCPNet - Temporal-attentive-Covariance-Pooling-Networks-for-Video-Recognition

State-of-the-art language models can match human performance on many tasks