LASAFT-Net-v2
Listen, Attend and Separate by Attentively aggregating Frequency Transformation
Woosung Choi, Yeong-Seok Jeong, Jinsung Kim, Jaehwa Chung, Soonyoung Jung, and Joshua D. Reiss
Demonstration (under construction)
Experimental Results
- Musdb 18
| model | vocals | drums | bass | other | AVG |
|---|---|---|---|---|---|
| Meta-TasNet | 6.40 | 5.91 | 5.58 | 4.19 | 5.52 |
| AMSS-Net | 6.78 | 5.92 | 5.10 | 4.51 | 5.58 |
| LaSAFT-Net-v1 | 7.33 | 5.68 | 5.63 | 4.87 | 5.88 |
| LASAFT-Net-v2 | 7.57 | 6.13 | 5.28 | 4.87 | 5.96 |
- MDX Challenge (Leaderboard A)
| model | model type | vocals | drums | bass | other | AVG |
|---|---|---|---|---|---|---|
| KUILAB-MDX-Net | dedicated (1 source/ 1 model) | 8.901 | 7.173 | 7.232 | 5.636 | 7.236 |
| LaSAFT-Net-v1 (light) | conditioned (4 sources/ 1 model) | 7.275 | 5.935 | 5.823 | 4.557 | 5.897 |
| LASAFT-Net-v2 (light) | conditioned (4 sources/ 1 model) | 7.324 | 5.976 | 5.884 | 4.642 | 5.957 |
How to reproduce
1. Environment
- Ubuntu 20.04
- wandb for logging
You must create .env file by copying .env.sample to set environmental variables.
wandb_api_key=[Your Key] # "xxxxxxxxxxxxxxxxxxxxxxxx"
data_dir=[Your Path] # "/home/ielab/repos/musdbHQ"
- about
wandb_api_key- we currently only support wandb for logging.
- for
wandb_api_key, visit wandb, go tosetting, and then copy your api key
- about
data_dir- the absolute path where datasets are stored
2. Installation (cuda)
conda env create -f environment.yaml -n lasaftv2
conda activate lasaftv2
pip install -r requirements.txt
2 Jan 03, 2022
820 Dec 26, 2022
1 Sep 21, 2022
40 Dec 11, 2022
65 Dec 27, 2022
101 Jan 01, 2023
131 Oct 21, 2022
6.7k Dec 28, 2022
2 May 11, 2022
876 Dec 09, 2022
3.2k Dec 31, 2022
167 Dec 27, 2022
22 Nov 26, 2021
157 Nov 20, 2022
3 Nov 06, 2022
105 Dec 17, 2022
32 Dec 21, 2022
8 Nov 09, 2022
87 Oct 19, 2022