i-SpaSP: Structured Neural Pruning via Sparse Signal Recovery

This is a public code repository for the publication:

i-SpaSP: Structured Neural Pruning via Sparse Signal Recovery
Cameron R Wolfe, Anastasios Kyrillidis

Environment/Dependencies

Requires anaconda to be installed (python3) Anaconda can be installed at https://www.anaconda.com/products/individual

conda create -n ispasp python=3.6 anaconda
conda activate ispasp
conda install pytorch torchvision torchaudio cudatoolkit=11.3 -c pytorch
pip install -r requirements.txt

File Arrangement

Here we summarize all files present in this repo and their purpose.

+-- prune_resnet34_ispasp.py : i-SpaSP implementation for ResNet34
+-- prune_mobilenetv2_ispasp.py : i-SpaSP implementation for MobileNetV2
+-- lib/ : utility/helper functions
|   +-- data.py: helper functions for handling data
|   +-- utils.py: helper functions for computing performance metrics
+-- scripts/ : contains python scripts for running pruning experiments
|   +-- prune_rn34_ispasp.py: run an i-SpaSP pruning experiment for ResNet34  
|   +-- prune_mbnv2_ispasp.py: run an i-SpaSP pruning experiment for MobileNetV2
+-- requirements.txt : dependencies for pruning experiments

i-SpaSP: Structured Neural Pruning via Sparse Signal Recovery

Related tags

Overview

i-SpaSP: Structured Neural Pruning via Sparse Signal Recovery

Environment/Dependencies

File Arrangement

Owner

Cameron Ronald Wolfe

ArcaneGAN by Alex Spirin

Official implement of "CAT: Cross Attention in Vision Transformer".

[ICML 2021, Long Talk] Delving into Deep Imbalanced Regression

📚 A collection of all the Deep Learning Metrics that I came across which are not accuracy/loss.

PyTorch implementation of HDN(Homography Decomposition Networks) for planar object tracking

RetinaFace: Deep Face Detection Library in TensorFlow for Python

Music source separation is a task to separate audio recordings into individual sources

Implementation of StyleSpace Analysis: Disentangled Controls for StyleGAN Image Generation in PyTorch

Geometric Vector Perceptron --- a rotation-equivariant GNN for learning from biomolecular structure

Harmonic Memory Networks for Graph Completion

Neural Magic Eye: Learning to See and Understand the Scene Behind an Autostereogram, arXiv:2012.15692.

Official code for "Maximum Likelihood Training of Score-Based Diffusion Models", NeurIPS 2021 (spotlight)

[ICCV 2021] Relaxed Transformer Decoders for Direct Action Proposal Generation

Neural network graphs and training metrics for PyTorch, Tensorflow, and Keras.

Implementation of STAM (Space Time Attention Model), a pure and simple attention model that reaches SOTA for video classification

NeoPlay is the project dedicated to ESport events.

Code base for NeurIPS 2021 publication titled Kernel Functional Optimisation (KFO)

Randomized Correspondence Algorithm for Structural Image Editing

Implementation for "Exploiting Aliasing for Manga Restoration" (CVPR 2021)

ExCon: Explanation-driven Supervised Contrastive Learning