FasterAI: A library to make smaller and faster models with FastAI.

Last update: Jan 01, 2023

Overview

Fasterai

fasterai is a library created to make neural network smaller and faster. It essentially relies on common compression techniques for networks such as pruning, knowledge distillation, ...

Project Documentation

Visit Read The Docs Project Page or read following README to know more about using Fasterai

Available Methods

1. Pruning

Make your model sparse (i.e. prune it) according to a:

Sparsity: the amount of weights that will be replaced by 0
Granularity: the granularity at which you operate the pruning (removing weights, vectors, kernels, filters)
Method: prune either each layer independantly (local pruning) or the whole model (global pruning)
Criteria: the criteria used to select the weights to remove (magnitude, movement, ...)
Schedule: which schedule you want to use for pruning (one shot, iterative, gradual, ...)

2. Knowledge Distillation

Distill the knowledge acquired by a big model into a smaller one.

3. Lottery Ticket Hypothesis

Find the winning ticket in you network, i.e. the initial subnetwork able to attain at least similar performances than the network as a whole.

Quick Start

1. Create your model with fastai

learn = cnn_learner(dls, model)

2. Get you Fasterai Callback

sp_cb=SparsifyCallback(end_sparsity, granularity, method, criteria, sched_func)

3. Train you model to make it sparse !

learn.fit_one_cycle(n_epochs, cbs=sp_cb)

More about other methods in the tutorials section

Installation

pip install git+https://github.com/nathanhubens/fasterai.git

pip install fasterai

Citing

@misc{Hubens:2020,
  Author = {Nathan Hubens},
  Title = {Fasterai},
  Year = {2020},
  Publisher = {GitHub},
  Journal = {GitHub repository},
  Howpublished = {\url{https://github.com/nathanhubens/fasterai}}
}

You might also like...

shufflev2-yolov5：lighter, faster and easier to deploy

shufflev2-yolov5: lighter, faster and easier to deploy. Evolved from yolov5 and the size of model is only 1.7M (int8) and 3.3M (fp16). It can reach 10+ FPS on the Raspberry Pi 4B when the input size is 320×320~

1.5k Jan 5, 2023

LF-YOLO (Lighter and Faster YOLO) is used to detect defect of X-ray weld image.

This project is based on ultralytics/yolov3. LF-YOLO (Lighter and Faster YOLO) is used to detect defect of X-ray weld image. Download $ git clone http

26 Dec 13, 2022

A Python package for faster, safer, and simpler ML processes

Bender 🤖 A Python package for faster, safer, and simpler ML processes. Why use bender? Bender will make your machine learning processes, faster, safe

6 Dec 13, 2022

Much faster than SORT(Simple Online and Realtime Tracking), a little worse than SORT

QSORT QSORT(Quick + Simple Online and Realtime Tracking) is a simple online and realtime tracking algorithm for 2D multiple object tracking in video s

8 Jul 27, 2022

This project is based on RIFE and aims to make RIFE more practical for users by adding various features and design new models

This project is based on RIFE and aims to make RIFE more practical for users by adding various features and design new models. Because improving the PSNR index is not compatible with subjective effects, we hope this part of work and our academic research are independent of each other.

190 Jan 8, 2023

LeViT a Vision Transformer in ConvNet's Clothing for Faster Inference

FasterAI: A library to make smaller and faster models with FastAI.

Related tags

Overview

Fasterai

Project Documentation

Available Methods

1. Pruning

2. Knowledge Distillation

3. Lottery Ticket Hypothesis

Quick Start

1. Create your model with fastai

2. Get you Fasterai Callback

3. Train you model to make it sparse !

Installation

Citing

You might also like...

shufflev2-yolov5：lighter, faster and easier to deploy

LF-YOLO (Lighter and Faster YOLO) is used to detect defect of X-ray weld image.

A Python package for faster, safer, and simpler ML processes

Much faster than SORT(Simple Online and Realtime Tracking), a little worse than SORT

This project is based on RIFE and aims to make RIFE more practical for users by adding various features and design new models

LeViT a Vision Transformer in ConvNet's Clothing for Faster Inference

Code to run experiments in SLOE: A Faster Method for Statistical Inference in High-Dimensional Logistic Regression.

PyTorch implementation of the Quasi-Recurrent Neural Network - up to 16 times faster than NVIDIA's cuDNN LSTM

A pytorch implementation of faster RCNN detection framework (Use detectron2, it's a masterpiece)

Releases(v0.1.9)

v0.1.9(Jul 4, 2022)

v0.1.8(May 29, 2022)

v0.1.6(Apr 19, 2022)

Owner

Nathan Hubens

Official Repsoitory for "Activate or Not: Learning Customized Activation." [CVPR 2021]

Repository aimed at compiling code, papers, demos etc.. related to my PhD on 3D vision and machine learning for fruit detection and shape estimation at the university of Lincoln

RLMeta is a light-weight flexible framework for Distributed Reinforcement Learning Research.

A developer interface for creating Chat AIs for the Chai app.

Out-of-Town Recommendation with Travel Intention Modeling (AAAI2021)

Roadmap to becoming a machine learning engineer in 2020

🏎️ Accelerate training and inference of 🤗 Transformers with easy to use hardware optimization tools

A very short and easy implementation of Quantile Regression DQN

On-device wake word detection powered by deep learning.

Memoized coduals - Shows that it is possible to implement reverse mode autodiff using a variation on the dual numbers called the codual numbers

Code of paper "Compositionally Generalizable 3D Structure Prediction"

Official Pytorch implementation of 'RoI Tanh-polar Transformer Network for Face Parsing in the Wild.'

The Official PyTorch Implementation of "LSGM: Score-based Generative Modeling in Latent Space" (NeurIPS 2021)

Official implementation of "SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers"

The Few-Shot Bot: Prompt-Based Learning for Dialogue Systems

In this project, we'll be making our own screen recorder in Python using some libraries.

PointNetVLAD: Deep Point Cloud Based Retrieval for Large-Scale Place Recognition, CVPR 2018

Style transfer, deep learning, feature transform

project page for VinVL

This repository contains the source code of an efficient 1D probabilistic model for music time analysis proposed in ICASSP2022 venue.