i-SpaSP: Structured Neural Pruning via Sparse Signal Recovery

This is a public code repository for the publication:

i-SpaSP: Structured Neural Pruning via Sparse Signal Recovery
Cameron R Wolfe, Anastasios Kyrillidis

Environment/Dependencies

Requires anaconda to be installed (python3) Anaconda can be installed at https://www.anaconda.com/products/individual

conda create -n ispasp python=3.6 anaconda
conda activate ispasp
conda install pytorch torchvision torchaudio cudatoolkit=11.3 -c pytorch
pip install -r requirements.txt

File Arrangement

Here we summarize all files present in this repo and their purpose.

+-- prune_resnet34_ispasp.py : i-SpaSP implementation for ResNet34
+-- prune_mobilenetv2_ispasp.py : i-SpaSP implementation for MobileNetV2
+-- lib/ : utility/helper functions
|   +-- data.py: helper functions for handling data
|   +-- utils.py: helper functions for computing performance metrics
+-- scripts/ : contains python scripts for running pruning experiments
|   +-- prune_rn34_ispasp.py: run an i-SpaSP pruning experiment for ResNet34  
|   +-- prune_mbnv2_ispasp.py: run an i-SpaSP pruning experiment for MobileNetV2
+-- requirements.txt : dependencies for pruning experiments

i-SpaSP: Structured Neural Pruning via Sparse Signal Recovery

Related tags

Overview

i-SpaSP: Structured Neural Pruning via Sparse Signal Recovery

Environment/Dependencies

File Arrangement

Owner

Cameron Ronald Wolfe

PyTorch Implementation of Vector Quantized Variational AutoEncoders.

Python scripts for performing stereo depth estimation using the HITNET Tensorflow model.

Differentiable Annealed Importance Sampling (DAIS)

8-week curriculum for AI Builders

[ICCV 2021] Counterfactual Attention Learning for Fine-Grained Visual Categorization and Re-identification

The pytorch implementation of SOKD (BMVC2021).

Implementing Vision Transformer (ViT) in PyTorch

A PyTorch implementation of the architecture of Mask RCNN

A Marvelous ChatBot implement using PyTorch.

Microsoft Cognitive Toolkit (CNTK), an open source deep-learning toolkit

Trainable Bilateral Filter Layer (PyTorch)

The implementation of the paper "HIST: A Graph-based Framework for Stock Trend Forecasting via Mining Concept-Oriented Shared Information".

This is the official repository of Music Playlist Title Generation: A Machine-Translation Approach.

Imitating Deep Learning Dynamics via Locally Elastic Stochastic Differential Equations

Open source person re-identification library in python

DRIFT is a tool for Diachronic Analysis of Scientific Literature.

MNIST, but with Bezier curves instead of pixels

Additional code for Stable-baselines3 to load and upload models from the Hub.

RoMa: A lightweight library to deal with 3D rotations in PyTorch.

The toolkit to generate auto labeled datasets