i-SpaSP: Structured Neural Pruning via Sparse Signal Recovery

This is a public code repository for the publication:

i-SpaSP: Structured Neural Pruning via Sparse Signal Recovery
Cameron R Wolfe, Anastasios Kyrillidis

Environment/Dependencies

Requires anaconda to be installed (python3) Anaconda can be installed at https://www.anaconda.com/products/individual

conda create -n ispasp python=3.6 anaconda
conda activate ispasp
conda install pytorch torchvision torchaudio cudatoolkit=11.3 -c pytorch
pip install -r requirements.txt

File Arrangement

Here we summarize all files present in this repo and their purpose.

+-- prune_resnet34_ispasp.py : i-SpaSP implementation for ResNet34
+-- prune_mobilenetv2_ispasp.py : i-SpaSP implementation for MobileNetV2
+-- lib/ : utility/helper functions
|   +-- data.py: helper functions for handling data
|   +-- utils.py: helper functions for computing performance metrics
+-- scripts/ : contains python scripts for running pruning experiments
|   +-- prune_rn34_ispasp.py: run an i-SpaSP pruning experiment for ResNet34  
|   +-- prune_mbnv2_ispasp.py: run an i-SpaSP pruning experiment for MobileNetV2
+-- requirements.txt : dependencies for pruning experiments

i-SpaSP: Structured Neural Pruning via Sparse Signal Recovery

Related tags

Overview

i-SpaSP: Structured Neural Pruning via Sparse Signal Recovery

Environment/Dependencies

File Arrangement

Owner

Cameron Ronald Wolfe

The toolkit to generate auto labeled datasets

Official implementation of AAAI-21 paper "Label Confusion Learning to Enhance Text Classification Models"

Code for the paper "Jukebox: A Generative Model for Music"

Official implementation for “Unsupervised Low-Light Image Enhancement via Histogram Equalization Prior”

An essential implementation of BYOL in PyTorch + PyTorch Lightning

Punctuation Restoration using Transformer Models for High-and Low-Resource Languages

A simple editor for captions in .SRT file extension

PaddlePaddle GAN library, including lots of interesting applications like First-Order motion transfer, wav2lip, picture repair, image editing, photo2cartoon, image style transfer, and so on.

Nested cross-validation is necessary to avoid biased model performance in embedded feature selection in high-dimensional data with tiny sample sizes

Structured Data Gradient Pruning (SDGP)

R-package accompanying the paper "Dynamic Factor Model for Functional Time Series: Identification, Estimation, and Prediction"

A PyTorch re-implementation of the paper 'Exploring Simple Siamese Representation Learning'. Reproduced the 67.8% Top1 Acc on ImageNet.

Official pytorch implementation of the paper: "SinGAN: Learning a Generative Model from a Single Natural Image"

KakaoBrain KoGPT (Korean Generative Pre-trained Transformer)

Transformer based SAR image despeckling

Official PyTorch Implementation of Mask-aware IoU and maYOLACT Detector [BMVC2021]

Look Who’s Talking: Active Speaker Detection in the Wild

A Python framework for developing parallelized Computational Fluid Dynamics software to solve the hyperbolic 2D Euler equations on distributed, multi-block structured grids.

Implementation of Hourglass Transformer, in Pytorch, from Google and OpenAI

Pytorch implementation of U-Net, R2U-Net, Attention U-Net, and Attention R2U-Net.