efficient neural audio synthesis in the waveform domain

Last update: Dec 23, 2022

Overview

neural waveshaping synthesis

real-time neural audio synthesis in the waveform domain

paper • website • colab • audio

by Ben Hayes, Charalampos Saitis, György Fazekas

This repository is the official implementation of Neural Waveshaping Synthesis.

Model Architecture

Requirements

To install:

pip install -r requirements.txt
pip install -e .

We recommend installing in a virtual environment.

Data

We trained our checkpoints on the URMP dataset. Once downloaded, the dataset can be preprocessed using scripts/create_urmp_dataset.py. This will consolidate recordings of each instrument within the dataset and preprocess them according to the pipeline in the paper.

python scripts/create_urmp_dataset.py \
  --gin-file gin/data/urmp_4second_crepe.gin \ 
  --data-directory /path/to/urmp \
  --output-directory /path/to/output \
  --device cuda:0  # torch device string for CREPE model

Alternatively, you can supply your own dataset and use the general create_dataset.py script:

python scripts/create_dataset.py \
  --gin-file gin/data/urmp_4second_crepe.gin \ 
  --data-directory /path/to/dataset \
  --output-directory /path/to/output \
  --device cuda:0  # torch device string for CREPE model

Training

To train a model on the URMP dataset, use this command:

python scripts/train.py \
  --gin-file gin/train/train_newt.gin \
  --dataset-path /path/to/processed/urmp \
  --urmp \
  --instrument vn \  # select URMP instrument with abbreviated string
  --load-data-to-memory

Or to use a non-URMP dataset:

python scripts/train.py \
  --gin-file gin/train/train_newt.gin \
  --dataset-path /path/to/processed/data \
  --load-data-to-memory

efficient neural audio synthesis in the waveform domain

Related tags

Overview

neural waveshaping synthesis

real-time neural audio synthesis in the waveform domain

paper • website • colab • audio

Model Architecture

Requirements

Data

Training

Owner

Ben Hayes

Individual Tree Crown classification on WorldView-2 Images using Autoencoder -- Group 9 Weak learners - Final Project (Machine Learning 2020 Course)

This repository attempts to replicate the SqueezeNet architecture and implement the same on an image classification task.

PyTorch implementation of "Dataset Knowledge Transfer for Class-Incremental Learning Without Memory" (WACV2022)

This framework implements the data poisoning method found in the paper Adversarial Examples Make Strong Poisons

Neural Surface Maps

A torch.Tensor-like DataFrame library supporting multiple execution runtimes and Arrow as a common memory format

pytorch bert intent classification and slot filling

PyTorch Implementation of Region Similarity Representation Learning (ReSim)

TyXe: Pyro-based BNNs for Pytorch users

OSLO: Open Source framework for Large-scale transformer Optimization

Projects of Andfun Yangon

[CVPR 2021] Released code for Counterfactual Zero-Shot and Open-Set Visual Recognition

Hi Guys, here I am providing examples, which will help you in Lerarning Python

This is an example of a reproducible modelling project

DuBE: Duple-balanced Ensemble Learning from Skewed Data

Minimal PyTorch implementation of YOLOv3

Bayesian Optimization Library for Medical Image Segmentation.

Code for Phase diagram of Stochastic Gradient Descent in high-dimensional two-layer neural networks

A PaddlePaddle implementation of Time Interval Aware Self-Attentive Sequential Recommendation.

Multi-Scale Progressive Fusion Network for Single Image Deraining